Using loop pagination on single.php

I want the main front-page loop to show in a section on both index.php AND single.php templates, with pagination.

Pagination works fine on the homepage, but not on single posts. This is the code (outside the loop that gets the single post):

query_posts(array(
  'post__not_in' => array($post->ID),
  'caller_get_posts' => 1,
  'posts_per_page' => 20,
  'paged' => ''.get_query_var('paged').'' ));
if (have_posts()) : while (have_posts()) : the_post();
  include 'post.php';
endwhile; endif;
get_previous_posts_link();
get_next_posts_link();

I have tried several other functions for navigation with similar results: On posts, /page/2 is added to the end of the permalink and then ignored.

(Final goal is to have infinite scroll working inside single posts too. The result up to now can be seen here – www.riscograma.ro – the middle column being the main loop.)

So, can pagination inside single.php be done?