fandomwire.com
robots.txt
Robots Exclusion Standard data for fandomwire.com
Resource Scan
Scan Details
Site Domain | fandomwire.com |
Base Domain | fandomwire.com |
Scan Status | Ok |
Last Scan | 2024-11-12T21:33:32+00:00 |
Next Scan | 2024-11-19T21:33:32+00:00 |
Last Scan
Scanned | 2024-11-12T21:33:32+00:00 |
URL | https://fandomwire.com/robots.txt |
Domain IPs | 104.17.15.101 |
Response IP | 104.17.15.101 |
Found | Yes |
Hash | f84d7b22223d09b3fb0bed900d7605706d0285fc77c91d8899e72590a0446a9b |
SimHash | 549d1d0de680 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /go/ |
Disallow | /trackback/ |
Disallow | /readme.html |
Disallow | /?s=* |
Disallow | /search/ |
Disallow | /page/* |
Disallow | /*?filter_by* |
Disallow | /?order* |
Disallow | *?bimber_random_post* |
Disallow | /?amp* |
Disallow | /*?action= |
Disallow | /*%26action%3D |
Disallow | /*?preview= |
Disallow | /*%26preview%3D |
Disallow | /*?ref= |
Disallow | /*%26ref%3D |
Disallow | /cdn-cgi/ |
Disallow | /cdn-cgi/* |
Other Records
Field | Value |
---|---|
sitemap | https://fandomwire.com/sitemap.xml |