bestcrossfitshoe.net
robots.txt
Robots Exclusion Standard data for bestcrossfitshoe.net
Resource Scan
Scan Details
Site Domain | bestcrossfitshoe.net |
Base Domain | bestcrossfitshoe.net |
Scan Status | Ok |
Last Scan | 2024-10-03T07:55:00+00:00 |
Next Scan | 2024-10-10T07:55:00+00:00 |
Last Scan
Scanned | 2024-10-03T07:55:00+00:00 |
URL | https://bestcrossfitshoe.net/robots.txt |
Domain IPs | 104.21.42.159, 172.67.163.134, 2606:4700:3032::6815:2a9f, 2606:4700:3032::ac43:a386 |
Response IP | 104.21.42.159 |
Found | Yes |
Hash | 76916b01960d99428e3218e94b14288be026a2ed06e83eb097972fe60477c764 |
SimHash | 5320dc02cf97 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /contact-2/ |
Disallow | /typography/ |
Disallow | /author/ |
Disallow | /?s= |
Disallow | /attachments/ |
Disallow | /archives/ |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.bestcrossfitshoe.net/post-sitemap.xml |