vintagemagazines.com
robots.txt

Robots Exclusion Standard data for vintagemagazines.com

Resource Scan

Scan Details

Site Domain vintagemagazines.com
Base Domain vintagemagazines.com
Scan Status Ok
Last Scan2024-05-11T08:01:22+00:00
Next Scan 2024-06-10T08:01:22+00:00

Last Scan

Scanned2024-05-11T08:01:22+00:00
URL https://vintagemagazines.com/robots.txt
Redirect https://www.vintagemagazines.com/robots.txt
Redirect Domain www.vintagemagazines.com
Redirect Base vintagemagazines.com
Domain IPs 104.21.78.202, 172.67.137.113, 2606:4700:3030::ac43:8971, 2606:4700:3037::6815:4eca
Redirect IPs 104.21.78.202, 172.67.137.113, 2606:4700:3030::ac43:8971, 2606:4700:3037::6815:4eca
Response IP 172.67.137.113
Found Yes
Hash 9eb4cb92662c544d4f72756ee6d0b8ca3118eea2c77067e6dd9a3795fa511a34
SimHash 653173f646b5

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-news

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

googlebot-video

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

storebot-video

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

msnbot-media

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

adidxbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5