General J2EE: Can any one know web crawler that support cookies

  1. Hey, I need to write a http data source that crawl a given site , send the HTML content to a service and store all the url that accessible in some Data Structure(Can be a DB). I want that this crawler will support in cookies and it will be great if it will support in "hot update". Can any one recommend me on web crawler (open source)? Thank you
  2. Planning to send some spam?
  3. Planning to send some spam?
    Hey Christ....If you donno...please ignore it..... Anyways, there lot of open sources available in the market for crawling... One of them is WebSPHINX. It is good and easy to use....