sgprogram.it
robots.txt

Robots Exclusion Standard data for sgprogram.it

Resource Scan

Scan Details

Site Domain sgprogram.it
Base Domain sgprogram.it
Scan Status Ok
Last Scan2024-09-09T08:39:54+00:00
Next Scan 2024-10-09T08:39:54+00:00

Last Scan

Scanned2024-09-09T08:39:54+00:00
URL https://sgprogram.it/robots.txt
Domain IPs 104.21.87.83, 172.67.142.132, 2606:4700:3035::6815:5753, 2606:4700:3037::ac43:8e84
Response IP 172.67.142.132
Found Yes
Hash 9a0bf50f53ed9dc3d95a93168d5ecdf58e42ed6ce9d80596b4c571bd7c5662a6
SimHash ed10ca26e29b

Groups

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

ninjabot

Rule Path
Allow /

*

Rule Path
Disallow /*/feed/
Disallow /*/feed/rss/
Disallow /*/trackback/
Disallow /comments/
Disallow */comments/
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-content/wflogs/
Disallow /feed/
Disallow /trackback/
Disallow /tag/
Disallow /test-newsletter/

Other Records

Field Value
sitemap https://sgprogram.it/sitemap_index.xml