LittleScanner is a FREE and OPEN SOURCE script to scan hidden or unlinked directories and pages hosted on a Web Server.
Why I need an URL Scanner ?
Sometimes I need to understand if there is hidden or unlinked directories hosted on a web server. Every day I work with lots web-based applications and everyday users asks for more features and new improvements and I was unable to check automatically all applications hosted on our systems.
For this reason I decide to write a script that checks automatically all the urls hosted on a web server, based on dictionary files for directories and pages.
How it works ?
The script make standard GET requests ( composed by “http://” + “web server ip/hostname + “/” + “directory loaded by dictionary file” + “/” + “page loaded by dictionary file” ) and analyze the standard responses coming from web server (404, 200, 301, etc…).
The script is written in perl and can be used on *NIX and Windows systems…..even if I tested on Linux Boxes Only 🙂
How to Install
Download littlescanner-latest.tar.gz from Downloads page (You can extract the archive on Windows using WinRAR )
– Extract it in a directory (Ex: /tmp/littlescanner021/ or C:TempLittlescanner021)
– Check littlescanner.pl to be executable (Ex: chmod 755 littlescanner.pl)
– Add your personal words to dirlist.txt and pagelist.txt dictionary files, using ONE word per line.
– Edit littlescanner.pl and configureÂ your personal parameters (dictionary file name, time delay between requests, etc…)
– Type “./littlescanner.pl <domainname>” or “perl littlescanner.pl <domain name>”
Example: [andrea@testbox ~]$./littlescanner.pl www.mytestdomain.com
– You can read “live” all requests or checkÂ littlescanner.log (saved in the same directory).