adequate.com
robots.txt
Robots Exclusion Standard data for adequate.com
Resource Scan
Scan Details
Site Domain | adequate.com |
Base Domain | adequate.com |
Scan Status | Ok |
Last Scan | 2025-05-29T08:42:11+00:00 |
Next Scan | 2025-06-05T08:42:11+00:00 |
Last Scan
Scanned | 2025-05-29T08:42:11+00:00 |
URL | https://adequate.com/robots.txt |
Domain IPs | 104.21.53.200, 172.67.218.118, 2606:4700:3035::ac43:da76, 2606:4700:3037::6815:35c8 |
Response IP | 104.21.53.200 |
Found | Yes |
Hash | 82bd30cd82e906db66374ec9ec7110a300e10cfce5abf49dca4b2b757cf679db |
SimHash | d20ed2826a39 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi |
Disallow | /cgi-bin |
Disallow | /logs |
Disallow | /mov |
Disallow | /snd |
Disallow | /torpe |
Disallow | /*.DOC$ |
Disallow | /*.M4V$ |
Disallow | /*.MP3$ |
Disallow | /*.MPEG$ |
Disallow | /*.MPG$ |
Disallow | /*.XLS$ |
Disallow | /*.doc$ |
Disallow | /*.gif$ |
Disallow | /*.Gif$ |
Disallow | /*.GIF$ |
Disallow | /*.jpg$ |
Disallow | /*.Jpg$ |
Disallow | /*.JPG$ |
Disallow | /*.jpeg$ |
Disallow | /*.Jpeg$ |
Disallow | /*.JPEG$ |
Disallow | /*.m4v$ |
Disallow | /*.mov$ |
Disallow | /*.mp3$ |
Disallow | /*.mpeg$ |
Disallow | /*.mpg$ |
Disallow | /*.pdf$ |
Disallow | /*.Pdf$ |
Disallow | /*.PDF$ |
Disallow | /*.png$ |
Disallow | /*.xls$ |
Disallow | /*.zip$ |
Disallow | /*.Zip$ |
Disallow | /*.ZIP$ |
Other Records
Field | Value |
---|---|
crawl-delay | 0.5 |