There have been posts on this site asking what the best method is to retrieve a large amount of data (1000+ rows) from a database. The suggested approach is to use a page-by-page iterator, as seen on http://java.sun.com/blueprints/patterns/j2ee_patterns/page_by_page_iterator/index.html
My question is, how do you implement a page-by-page iterator with CMP beans?
Right now, I am using a simple finder to retrieve a Collection of 1000+ entity beans. How would I implement a page-by-page iterator and bypass the finder method (because this is expensive since there are many remote calls to populate each bean's data). I guess I could roll my own JDBC code, but this introduces longer coding times, handling JDBC failure conditions, getting JDBC connections, etc... Is it really worth it?
Thanks for any help!!