gearstoday.com
robots.txt
Robots Exclusion Standard data for gearstoday.com
Resource Scan
Scan Details
Site Domain | gearstoday.com |
Base Domain | gearstoday.com |
Scan Status | Ok |
Last Scan | 5/21/2025, 1:23:09 PM |
Next Scan | 5/28/2025, 1:23:09 PM |
Last Scan
Scanned | 5/21/2025, 1:23:09 PM |
URL | https://gearstoday.com/robots.txt |
Domain IPs | 104.21.89.118, 172.67.141.162, 2606:4700:3030::6815:5976, 2606:4700:3034::ac43:8da2 |
Response IP | 172.67.141.162 |
Found | Yes |
Hash | 891c9add83cbfd75bf9f828f3419fb2635731d4c1c23c92c8224486c3077a688 |
SimHash | 6d155f685692 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /linkout/ |
Disallow | /recommended/ |
Disallow | /trackback/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.gearstoday.com/sitemaps.xml |