freenft.com
robots.txt

Robots Exclusion Standard data for freenft.com

Resource Scan

Scan Details

Site Domain freenft.com
Base Domain freenft.com
Scan Status Ok
Last Scan2024-08-31T06:03:03+00:00
Next Scan 2024-09-30T06:03:03+00:00

Last Scan

Scanned2024-08-31T06:03:03+00:00
URL https://freenft.com/robots.txt
Domain IPs 104.18.24.3, 104.18.25.3, 2606:4700::6812:1803, 2606:4700::6812:1903
Response IP 104.18.24.3
Found Yes
Hash 85306879f6755a93872c20bd71b1d9f357bfd959783cb5758f924a4b7fbf1a0e
SimHash 4954dd554531

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://freenft.com/sitemap.xml

Comments

  • Allow all crawlers