forumcorriere.corriere.it
robots.txt

Robots Exclusion Standard data for forumcorriere.corriere.it

Resource Scan

Scan Details

Site Domain forumcorriere.corriere.it
Base Domain corriere.it
Scan Status Ok
Last Scan2024-05-17T16:19:06+00:00
Next Scan 2024-06-16T16:19:06+00:00

Last Scan

Scanned2024-05-17T16:19:06+00:00
URL https://forumcorriere.corriere.it/robots.txt
Domain IPs 2600:9000:260f:0:13:8edc:1f00:93a1, 2600:9000:260f:3e00:13:8edc:1f00:93a1, 2600:9000:260f:8200:13:8edc:1f00:93a1, 2600:9000:260f:8400:13:8edc:1f00:93a1, 2600:9000:260f:9e00:13:8edc:1f00:93a1, 2600:9000:260f:ca00:13:8edc:1f00:93a1, 2600:9000:260f:da00:13:8edc:1f00:93a1, 2600:9000:260f:e800:13:8edc:1f00:93a1, 3.163.24.110, 3.163.24.22, 3.163.24.5, 3.163.24.73
Response IP 18.165.171.124
Found Yes
Hash 82140753425223bcf912a575cd016f4ed9849c26821dc3bdca9d5d8fa6d65793
SimHash 4a2cc820ab33

Groups

apw.js

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

twitterbot

Rule Path
Disallow *
Allow /wp-content/uploads/*

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Disallow /

google-extended

Rule Path
Disallow /

Warnings

  • `‍‍user-agent` is not a known field.