amazingdiscoveries.org
robots.txt

Robots Exclusion Standard data for amazingdiscoveries.org

Resource Scan

Scan Details

Site Domain amazingdiscoveries.org
Base Domain amazingdiscoveries.org
Scan Status Ok
Last Scan2024-08-25T00:26:13+00:00
Next Scan 2024-09-24T00:26:13+00:00

Last Scan

Scanned2024-08-25T00:26:13+00:00
URL https://amazingdiscoveries.org/robots.txt
Domain IPs 52.84.229.106, 52.84.229.11, 52.84.229.92, 52.84.229.98
Response IP 52.84.229.98
Found Yes
Hash 7089c0219f9bcbc3a5b2e8d161691fd6948a25d0add7f6efdfaa56ee66c283c0
SimHash 2e39144f6fc2

Groups

*

Rule Path
Disallow /search

Other Records

Field Value
sitemap https://adtv.watch/sitemap.xml
sitemap https://adtv.watch/video-sitemap.xml

Comments

  • Disable indexing of video links with time codes
  • Sitemaps
  • Search Results page

Warnings

  • 1 invalid line.
  • `user agent` is not a known field.