external-cdt1-1.xx.fbcdn.net
robots.txt

Robots Exclusion Standard data for external-cdt1-1.xx.fbcdn.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	external-cdt1-1.xx.fbcdn.net
Base Domain	fbcdn.net
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2024-10-20T12:40:45+00:00
Next Scan	2025-01-18T12:40:45+00:00

Last Successful Scan

Scanned	2023-03-08T08:59:49+00:00
URL	https://external-cdt1-1.xx.fbcdn.net/robots.txt
Domain IPs	157.240.21.20, 2a03:2880:f030:13:face:b00c:0:3
Response IP	157.240.21.20
Found	Yes
Hash	54464f1a238d033bf520a90c1f95b46fd80befee46ef404b9c60bf3874e832f0
SimHash	f8005511465d

Groups

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot-image

Rule	Path
Disallow	/
Disallow	/map_tile.php
Disallow	/static_map.php

Rule

Path

Disallow

/map_tile.php

Disallow

/static_map.php

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

naverbot

Rule	Path
Disallow	/

Rule

Path

Disallow

screaming frog seo spider

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

teoma

Rule	Path
Disallow	/

Rule

Path

Disallow

twitterbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

yeti

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

baiduspider

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

bingbot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

googlebot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

ia_archiver

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

msnbot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

naverbot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

screaming frog seo spider

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

seznambot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

slurp

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

teoma

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

twitterbot

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

yandex

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

yeti

Rule	Path
Allow	/map_tile.php
Allow	/security/hsts-pixel.gif
Allow	/static_map.php

Rule

Path

Allow

/map_tile.php

Allow

/security/hsts-pixel.gif

Allow

/static_map.php

*

Rule	Path
Disallow	/

Rule

Path

Disallow

Comments

Notice: Collection of data on Facebook through automated means is
prohibited unless you have express written permission from Facebook
and may only be conducted for the limited purpose contained in said
permission.
See: http://www.facebook.com/apps/site_scraping_tos_terms.php

external-cdt1-1.xx.fbcdn.netrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

applebot

baiduspider

bingbot

googlebot

googlebot-image

ia_archiver

msnbot

naverbot

screaming frog seo spider

seznambot

slurp

teoma

twitterbot

yandex

yeti

applebot

baiduspider

bingbot

googlebot

ia_archiver

msnbot

naverbot

screaming frog seo spider

seznambot

slurp

teoma

twitterbot

yandex

yeti

*

Comments

external-cdt1-1.xx.fbcdn.net
robots.txt