text-generator.org
robots.txt

Robots Exclusion Standard data for text-generator.org

Resource Scan

Scan Details

Site Domain text-generator.org
Base Domain text-generator.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-19T19:47:34+00:00
Next Scan 2024-09-26T19:47:34+00:00

Last Successful Scan

Scanned2024-09-11T15:31:22+00:00
URL https://text-generator.org/robots.txt
Domain IPs 2a02:4780:38:b8a9:e369:d47e:519a:6bcb, 91.108.100.166
Response IP 77.37.75.149
Found Yes
Hash 68f9cfcffe2d67b9d4dd9fc58d68a31c225acef80613f7d1c60ba057c5ccc72d
SimHash af38ce408d31

Groups

*

Rule Path
Disallow /*.html

*

Rule Path
Disallow /*.shtml

Other Records

Field Value
sitemap https://text-generator.org/sitemap.xml