giantessa.net
robots.txt
Robots Exclusion Standard data for giantessa.net
Resource Scan
Scan Details
Site Domain | giantessa.net |
Base Domain | giantessa.net |
Scan Status | Ok |
Last Scan | 2024-09-22T14:13:46+00:00 |
Next Scan | 2024-10-22T14:13:46+00:00 |
Last Scan
Scanned | 2024-09-22T14:13:46+00:00 |
URL | https://giantessa.net/robots.txt |
Domain IPs | 104.21.96.133, 172.67.180.254, 2606:4700:3033::ac43:b4fe, 2606:4700:3037::6815:6085 |
Response IP | 172.67.180.254 |
Found | Yes |
Hash | 2e5a1766b4312d5721f4dbf0ae1a4013d4bc43febd3205b2ad2e41df26260738 |
SimHash | 495187324ab0 |
Groups
*
Rule | Path | Comment |
---|---|---|
Disallow | /*action | - |
Disallow | /*topic%3D*.msg | - |
Disallow | /*topic%3D*.new | - |
Disallow | /*.giantessa.net | - |
Disallow | *rss* | - |
Disallow | *wap* | - |
Disallow | *wap2* | - |
Disallow | *imode* | - |
Disallow | /*%3B | - |
Disallow | /*PHPSESSID | - |
Allow | /$ | - |
Allow | /*board | - |
Allow | /*topic | - |
Allow | /*action%3Ddlattach | - |
Allow | /*action%3D.xml | - |
Allow | /*sitemap | sitemap |
Other Records
Field | Value | Comment |
---|---|---|
sitemap | https://giantessa.net/sitemap.xml | path sitemap |
Warnings
- `host` is not a known field.
Comments