romancenoar.pt
robots.txt

Robots Exclusion Standard data for romancenoar.pt

Resource Scan

Scan Details

Site Domain romancenoar.pt
Base Domain romancenoar.pt
Scan Status Ok
Last Scan2024-11-06T00:37:05+00:00
Next Scan 2024-12-06T00:37:05+00:00

Last Scan

Scanned2024-11-06T00:37:05+00:00
URL https://romancenoar.pt/robots.txt
Redirect https://www.romancenoar.pt/robots.txt
Redirect Domain www.romancenoar.pt
Redirect Base romancenoar.pt
Domain IPs 104.131.212.51, 138.68.208.214
Redirect IPs 2600:1413:b000:1b::17d7:709, 2600:1413:b000:1b::17d7:71f, 96.17.180.42, 96.17.180.48
Response IP 96.17.180.42
Found Yes
Hash b441db346b1cb32bfd1d3474b2ca83cc01035e878e6d744ffe4f20a6f4f29285
SimHash 38044840c373

Groups

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.romancenoar.pt/sitemap.xml