CLI tool
CanUscrape
Developed a Ruby auditor that parses robots.txt for directory directives and sitemap information, presenting reconnaissance findings in color-coded terminal output for authorized security review.
CanUscrape
- robots.txt
- Ruby parser
- CLI report
Overview
Developed a Ruby auditor that parses robots.txt for directory directives and sitemap information, presenting reconnaissance findings in color-coded terminal output for authorized security review.
Implementation
A Ruby command-line tool with color-coded output. It reads robots.txt information and presents reconnaissance findings for ethical security testing.
- robots.txt auditing
- Directory and sitemap reconnaissance
- Color-coded command-line output