LittleScanner is a FREE and OPEN SOURCE script to scan hidden or unlinked directories and pages hosted on a Web Server.

Why I need an URL Scanner ?

Sometimes I need to understand if there is hidden or unlinked directories hosted on a web server. Every day I work with lots web-based applications and everyday users asks for more features and new improvements and I was unable to check automatically all applications hosted on our systems.

For this reason I decide to write a script that checks automatically all the urls hosted on a web server, based on dictionary files for directories and pages.

How it works ?

The script make standard GET requests ( composed by “http://” + “web server ip/hostname + “/” + “directory loaded by dictionary file” + “/” + “page loaded by dictionary file” ) and analyze the standard responses coming from web server (404, 200, 301, etc…).

The script is written in perl and can be used on *NIX and Windows systems…..even if I tested on Linux Boxes Only 🙂

How to Install

– Download littlescanner-latest.tar.gz from Downloads page (You can extract the archive on Windows using WinRAR)

– Extract it in a directory (Ex: /tmp/littlescanner021/ or C:TempLittlescanner021)
– Check littlescanner.pl to be executable (Ex: chmod 755 littlescanner.pl)
– Add your personal words to dirlist.txt and pagelist.txt dictionary files, using ONE word per line.
– Edit littlescanner.pl and configure  your personal parameters (dictionary file name, time delay between requests, etc…)
– Type “./littlescanner.pl <domainname>” or “perl littlescanner.pl <domain name>”
Example: [andrea@testbox ~]$./littlescanner.pl www.mytestdomain.com

– You can read “live” all requests or check  littlescanner.log (saved in the same directory).