Blue Crab Lite is a an app that you use to copy a web site to your computer and then search its contents. It tries to download all the linked data including HTML, graphics, videos, PDFs, etc. automatically. And then you can search or browse the downloaded site without any internet connection.
Visit our website for other information and a demo.
Starting with a single URL Blue Crab Lite begins traversing the site by following the links on the textual pages it finds, HTML, CSS, etc. Blue Crab Lite does not stray off the domain of the starting URL, so it won't get lost. It knows how to stop because it never downloads the same URL twice, and it remembers what has already been downloaded.
Once you download a collection of files on a website you can search them with the built in text search window, which displays results in a hierarchical fashion. You can also search the downloaded files in the Finder with Spotlight.
• Completeness. Unique URL finding methods yield very complete downloads.
• Browse Offline. Downloaded web sites can be browsed offline, because the links in each page have been relinked to point to the proper files now on disk.
• Easy to use. Tool tips exist on all user interface items for learning the program quickly.
• Protocols. Supports both HTTP and secure HTTPS.
• Offsite links. You can allow the app to download resources it finds on other domains, improving the display of pages offline. Select the option "Grab Offsite URLs" in preferences.
• Stay in folder. You can restrict Blue Crab Lite to a subset of the given website using the convenient "stay in folder" option available in every grabber window. This restricts the crawl to URLs whose path must begin with the same path as the starting URL.
• Subdomains. You can enable Blue Crab Lite to move across "second level" parts of a domain it finds, such as from "www.site.com" to "images.site.com." Select the option "Allow Secondary Domains" in preferences.
• Search. The built-in directory search engine displays found files as a hierarchical list that matches the structure of the site, with double-clickable entries to open and view them in the appropriate application.
• Progress. In addition to displaying detailed progress in a window, Dock badging provides visual feedback of progress when the program is in the background.
Blue Crab Lite is a trimmed version of the app Blue Crab: https://itunes.apple.com/us/app/blue-crab/id425647713?lmt=12
• Update for Mac OS 10.11
• Fixed a bug opening the download directory from the grabber window (the 'Reveal' button), and similar problems with other convenience functions that open folders or files.
Ratings and Reviews
Does what I need it to do
I was looking for an extremely simple way to back up a website as HTML files and assoicated image, etc., files. I did not want one of those archivers that simply takes a picture of each page. This app does exactly what I wanted. It places the all the files into <user>/Library/Application Support/Limit Point Software/Blue Crab Lite/. Pressing Blue Crab Lite's "Reveal" button launches a Finder window for that location. The website can be displayed by double-clicking on the file with the "alias" extension (points to the archived index file). My default browser was launched and I could then browse through the website offline. It seemed to have retrieved all the pieces for my incomplete website (HTML, graphics, graphics displayed by pop-up windows).
Archiving my website took (according to Blue Crab Lite's log) 2 minutes and 12 seconds. The end result was approximately 3 MB in size.
The reason I did not give it 5 stars is due to one minor bug. One of the graphics did not display because the website's html had two dots in front of the file name (../images/<file name>). It did capture the file and placed it in the images folder used by references without the two dots. I created an images folder containing that file at the top level (where the alias is at) and now the browser can find it. I will check their website for a support section and let them know of this problem.
I am running it on a 2010-vintage iMac with Mountain Lion (10.8.2) and a medium-speed DSL connection.
With Family Sharing set up, up to six family members can use this app.