hujanparis.com
robots.txt

Robots Exclusion Standard data for hujanparis.com

Resource Scan

Scan Details

Site Domain hujanparis.com
Base Domain hujanparis.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-11-06T00:07:34+00:00
Next Scan 2024-12-06T00:07:34+00:00

Last Successful Scan

Scanned2024-09-15T00:00:07+00:00
URL https://hujanparis.com/robots.txt
Redirect https://www.hansondirectory.com/robots.txt
Redirect Domain www.hansondirectory.com
Redirect Base hansondirectory.com
Domain IPs 104.21.93.35, 172.67.204.53, 2606:4700:3035::6815:5d23, 2606:4700:3035::ac43:cc35
Redirect IPs 118.139.180.210
Response IP 118.139.180.210
Found Yes
Hash 89b0a446284855ba6e55954df2ca86a108ec64c121cf7f1271d077949e254cd5
SimHash 2911d315c791

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /*.png$
Allow /*.webp$

dmca.com page protection crawling service

Rule Path
Allow /

architextspider

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

applebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

screaming frog seo spider

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

yahoo pipes 1.0

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

yeti

Rule Path
Allow /

zyborg

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.hansondirectory.com/sitemap.xml

Warnings

  • 2 invalid lines.