diffco.us
robots.txt
Robots Exclusion Standard data for diffco.us
Resource Scan
Scan Details
Site Domain | diffco.us |
Base Domain | diffco.us |
Scan Status | Ok |
Last Scan | 2025-09-21T18:08:50+00:00 |
Next Scan | 2025-10-21T18:08:50+00:00 |
Last Scan
Scanned | 2025-09-21T18:08:50+00:00 |
URL | https://diffco.us/robots.txt |
Domain IPs | 104.26.8.137, 104.26.9.137, 172.67.74.75, 2606:4700:20::681a:889, 2606:4700:20::681a:989, 2606:4700:20::ac43:4a4b |
Response IP | 104.26.9.137 |
Found | Yes |
Hash | f5b2893b424444874cb47254520b66a23042114eb59e32235c555d3e323becfe |
SimHash | 330259648bb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/admin-ajax.php |
Disallow | /wp-admin/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Disallow | /comments |
Disallow | */trackback |
Disallow | */embed |
Disallow | */feed |
Disallow | /cgi-bin |
Disallow | *?s= |
Other Records
Field | Value |
---|---|
sitemap | https://diffco.us/sitemap_index.xml |