instafenomeni.net
robots.txt

Robots Exclusion Standard data for instafenomeni.net

Resource Scan

Scan Details

Site Domain instafenomeni.net
Base Domain instafenomeni.net
Scan Status Ok
Last Scan2025-03-14T20:06:27+00:00
Next Scan 2025-04-13T20:06:27+00:00

Last Scan

Scanned2025-03-14T20:06:27+00:00
URL https://instafenomeni.net/robots.txt
Domain IPs 104.21.44.53, 172.67.195.156, 2606:4700:3030::6815:2c35, 2606:4700:3030::ac43:c39c
Response IP 172.67.195.156
Found Yes
Hash af6f893e2acaf9846917c9bc81a1af24d53323038deb506d9ed4c9f189c5e231
SimHash 69001a72e393

Groups

*

Rule Path
Disallow
Allow /images/
Allow /css/
Allow /js/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://instafenomeni.net/sitemap.xml