the-updates.com
robots.txt

Robots Exclusion Standard data for the-updates.com

Resource Scan

Scan Details

Site Domain the-updates.com
Base Domain the-updates.com
Scan Status Ok
Last Scan2025-12-07T22:51:41+00:00
Next Scan 2025-12-14T22:51:41+00:00

Last Scan

Scanned2025-12-07T22:51:41+00:00
URL https://the-updates.com/robots.txt
Domain IPs 104.21.4.193, 172.67.154.45, 2606:4700:3032::ac43:9a2d, 2606:4700:3036::6815:4c1
Response IP 104.21.4.193
Found Yes
Hash ee34608f6f515a987da0e135b3ee8e9134ca79c5c02fedd7804510791bcce58f
SimHash 291499524751

Groups

*

Rule Path
Disallow /xmlrpc.php

oai-searchbot

Rule Path
Allow /

google-extended

Rule Path
Allow /

Other Records

Field Value
sitemap https://the-updates.com/sitemap.xml