Log In Sign Up

all-paris-apartments.com
robots.txt

Robots Exclusion Standard data for all-paris-apartments.com

Resource Scan

Scan Details

Site Domain all-paris-apartments.com
Base Domain all-paris-apartments.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-30T06:18:05+00:00
Next Scan 2025-01-28T06:18:05+00:00

Last Successful Scan

Scanned2023-12-12T22:15:39+00:00
URL https://www.all-paris-apartments.com/robots.txt
Domain IPs 82.223.69.117
Response IP 82.223.69.117
Found Yes
Hash 220495601db7bb73ec7394bb0d6fbb20c113230c083e8c6f3046abb4d933d3c4
SimHash 2030c9b3cb33

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /index.php5*
Disallow /ecos/
Disallow /ECOS/
Disallow /util/*
Disallow /en/s/
Disallow /es/s/
Disallow /de/s/
Disallow /fr/s/
Disallow /it/s/
Disallow /nl/s/
Disallow /en/c/
Disallow /es/c/
Disallow /de/c/
Disallow /fr/c/
Disallow /it/c/
Disallow /nl/c/
Disallow /en/secure/
Disallow /es/secure/
Disallow /de/secure/
Disallow /fr/secure/
Disallow /it/secure/
Disallow /nl/secure/
Disallow /en/mybooking/
Disallow /es/mybooking/
Disallow /de/mybooking/
Disallow /fr/mybooking/
Disallow /it/mybooking/
Disallow /nl/mybooking/

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

rogerbot

Rule Path
Allow /

npbot

Rule Path
Disallow /

voilabot

Rule Path
Allow /

rogerbot

Rule Path
Allow /

psbot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

superbot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

henrythemiragorobot

Rule Path
Disallow /

bumblebee@relevare.com

Rule Path
Disallow /

true_robot/1.0

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

szukacz/1.4

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus 32297 webster pro v2.9 win32

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

mj12bot/v1.0.7 (http://majestic12.co.uk/bot.php?+) [^] [^]

Rule Path
Disallow /

aspider/0.09

Rule Path
Disallow /

appie 1.1 (www.walhello.com)

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-video

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-news

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-favo

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-cpro

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider-ads

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

exabot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap http://www.all-paris-apartments.com/sitemap.xml
Back to top