shaghfdaily.com
robots.txt

Robots Exclusion Standard data for shaghfdaily.com

Resource Scan

Scan Details

Site Domain shaghfdaily.com
Base Domain shaghfdaily.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-27T01:44:52+00:00
Next Scan 2026-03-27T01:44:52+00:00

Last Successful Scan

Scanned2022-12-12T08:59:23+00:00
URL https://shaghfdaily.com/robots.txt
Domain IPs 2a02:2350:5:101:80b5:2f35:f0a1:7c12, 77.111.240.246
Response IP 77.111.240.246
Found Yes
Hash eab1c10a417e07a973af211d3334617003e5b8e0fe4492f45047a4d88bb5a666
SimHash 48080880e593

Groups

scrapy

Rule Path
Allow /
Disallow /wp-content/uploads/wpo-plugins-tables-list.json

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://shaghfdaily.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK