news-gpt.org
robots.txt

Robots Exclusion Standard data for news-gpt.org

Resource Scan

Scan Details

Site Domain news-gpt.org
Base Domain news-gpt.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-08T02:24:07+00:00
Next Scan 2025-11-06T02:24:07+00:00

Last Successful Scan

Scanned2025-04-04T00:47:44+00:00
URL https://news-gpt.org/robots.txt
Domain IPs 104.16.12.194, 104.16.13.194, 104.16.14.194, 104.16.15.194, 104.16.16.194, 2606:4700::6810:10c2, 2606:4700::6810:cc2, 2606:4700::6810:dc2, 2606:4700::6810:ec2, 2606:4700::6810:fc2
Response IP 104.16.12.194
Found Yes
Hash 089c5051916bab0fdcb7a9eadf530531106b0ce24309cfc0cc2211ce18cb41fd
SimHash a85c39cde573

Groups

*

Rule Path
Disallow /*?*cf_affiliate_id=*
Disallow /for_domain/*

Other Records

Field Value
sitemap https://www.clickfunnels.com/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file