instafenomeni.net
robots.txt
Robots Exclusion Standard data for instafenomeni.net
Resource Scan
Scan Details
Site Domain | instafenomeni.net |
Base Domain | instafenomeni.net |
Scan Status | Ok |
Last Scan | 2025-03-14T20:06:27+00:00 |
Next Scan | 2025-04-13T20:06:27+00:00 |
Last Scan
Scanned | 2025-03-14T20:06:27+00:00 |
URL | https://instafenomeni.net/robots.txt |
Domain IPs | 104.21.44.53, 172.67.195.156, 2606:4700:3030::6815:2c35, 2606:4700:3030::ac43:c39c |
Response IP | 172.67.195.156 |
Found | Yes |
Hash | af6f893e2acaf9846917c9bc81a1af24d53323038deb506d9ed4c9f189c5e231 |
SimHash | 69001a72e393 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | /images/ |
Allow | /css/ |
Allow | /js/ |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://instafenomeni.net/sitemap.xml |