Much better! Just adding pagination means I don't have to worry about missing new comments if I crawl too infrequently.
But the crawler is almost entirely unnecessary now. If you could make it convenient (ie no reload) to show the ancestors of comments (the context of each conversation) that pretty much covers all the features I built.
I've been using the new /newcomments. One other thing I noticed that's missing: it's not stateful. There's no way for me to kill off some users/threads so I don't see them again. I think my query mechanisms were pretty elegant and lightweight. hystry permitted filtering conversations (rather than comments) involving specific people, and also easily blacklisting going-nowhere threads.
But the crawler is almost entirely unnecessary now. If you could make it convenient (ie no reload) to show the ancestors of comments (the context of each conversation) that pretty much covers all the features I built.