I have been asked by several peeps now to add the ability to persist crawls when the pop-up window closes so I rolled out this update.
Now when you close the Chrome Crawler popup your crawl is saved so that when you open it up again you can resume.
Not only that but thanks to the awesomeness of the background page API in chrome I have now added the ability to crawl even when the popup isnt open.
To enable this head over to the option and untick the "Pause crawling when popup closes" option.
While I was at it I made a few other changes and improvements. The main one being that the "src" attribute on tags is also searched for when you crawl. What this means is that "interesting" images should show up in the files tab if you have images as interesting file types.
You should automatically get the update next time you restart chrome, or if you dont have the extension yet head over to the gallery to get it!
Great update Mike - super useful when multitasking in the browser.
ReplyDelete[...] resolution image) shows how we’re all interconnected. One can automate this process by using Chrome with a web crawler (or see the [...]
ReplyDeleteThis is precisely the solution I've been looking for regarding a QA approach to verifying links on a site. Xenu works great, of course, but is limited by a number of factors (Windows only, and a complex sessions/cookie management for authenticating link access) Using JS to crawl and then check links makes a lot of sense. I wrote Micheal privately to say that his script stops when it comes to mailto: links. Yet, this is a compelling link-crawling alternative idea and I hope it matures further.
ReplyDeleteKudos; and let me know if I can help.
Great extension Mike!
ReplyDeleteUnder what license have you released it? I'd like to fork it but can't find it on your GitHub.
Go!