jennifer365.com
robots.txt

Robots Exclusion Standard data for jennifer365.com

Resource Scan

Scan Details

Site Domain jennifer365.com
Base Domain jennifer365.com
Scan Status Ok
Last Scan2024-09-30T05:27:08+00:00
Next Scan 2024-10-30T05:27:08+00:00

Last Scan

Scanned2024-09-30T05:27:08+00:00
URL https://jennifer365.com/robots.txt
Domain IPs 104.26.12.141, 104.26.13.141, 172.67.73.189, 2606:4700:20::681a:c8d, 2606:4700:20::681a:d8d, 2606:4700:20::ac43:49bd
Response IP 104.26.13.141
Found Yes
Hash b2378e6df9a4e7784ca2257360be7ff8550721a2f7319f73a2f3f9878973c0b3
SimHash 4f1edf5056b4

Groups

googlebot
googlebot-image
googlebot-news
googlebot-video
storebot-googlebot
google-inspectiontool
googleother
google-extended
apis-google
adsbot-google-mobile
adsbot-google
mediapartners-google
feedfetcher-google
google-safety
googleproducer

Rule Path
Allow /

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

awariobot
awariosmartbot
aihitbot
barkrowler
baiduspider
baiduspider-render
blexbot
buck
bytespider
infotigerbot
seznambot
sogou
mail.ru_bot
megaindex.ru
mj12bot
petalbot
wellknownbot
yandexbot

Rule Path
Disallow /