Log In Sign Up

facebooks.com
robots.txt

Robots Exclusion Standard data for facebooks.com

Resource Scan

Scan Details

Site Domain facebooks.com
Base Domain facebooks.com
Scan Status Ok
Last Scan2024-10-18T09:30:05+00:00
Next Scan 2024-11-17T09:30:05+00:00

Last Scan

Scanned2024-10-18T09:30:05+00:00
URL http://facebooks.com/robots.txt
Redirect https://www.facebook.com/robots.txt
Redirect Domain www.facebook.com
Redirect Base facebook.com
Domain IPs 157.240.235.15, 2a03:2880:f00c:100:face:b00c:0:2
Redirect IPs 157.240.15.35, 2a03:2880:f10c:83:face:b00c:0:25de
Response IP 157.240.13.35
Found Yes
Hash f0cf1eac06306446790584491c3d6893655346cdc0d679994a8dbd8ef1c9c5ef
SimHash 7855d50466b7

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

viberbot

Rule Path
Disallow /

yak

Rule Path
Disallow /

yandex

Rule Path
Disallow /

applebot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

bingbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

discordbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

duckduckbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

facebookexternalhit

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

googlebot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

googlebot-image

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /map_tile.php
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /static_map.php
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

googlebot-video

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

googlebot-news

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

google-inspectiontool

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

linkedinbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

msnbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

naverbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

pinterestbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

screaming frog seo spider

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

seznambot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

slurp

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

teoma

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

telegrambot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

twitterbot

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

yeti

Rule Path
Disallow /*/plugins/*
Disallow /?*next=
Disallow /a/bz?
Disallow /ajax/
Disallow /album.php
Disallow /checkpoint/
Disallow /contact_importer/
Disallow /dialog/
Disallow /fbml/ajax/dialog/
Disallow /feeds/
Disallow /file_download.php
Disallow /job_application/
Disallow /l.php
Disallow /login.php*%26next%3D
Disallow /login.php/?next=
Disallow /login.php?next=
Disallow /login/*%26next%3D
Disallow /login/?next=
Disallow /login/device-based/regular/login/*%26next%3D
Disallow /login/device-based/regular/login/?next=
Disallow /moments_app/
Disallow /p.php
Disallow /photos.php
Disallow /plugins/
Disallow /share.php
Disallow /share/
Disallow /sharer.php
Disallow /sharer/
Disallow /tr/
Disallow /tr?
Disallow /ufi/reaction/profile/browser/
Disallow /x/oauth/
Allow /ajax/bootloader-endpoint/
Allow /ajax/pagelet/generic.php/PagePostsSectionPagelet
Allow /careers/
Allow /safetycheck/

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.facebook.com/sitemap/cpg_offplat_future_public_events_sitemap.xml.gz
sitemap https://www.facebook.com/sitemap/public_active_groups_sitemap.xml.gz
sitemap https://www.facebook.com/sitemap/groups_popular_posts_sitemap_qe.xml.gz
sitemap https://www.facebook.com/sitemap/groups_ifr_groups_sitemap.xml.gz
sitemap https://www.facebook.com/sitemap/groups_ifr_video_posts_sitemap.xml.gz
sitemap https://www.facebook.com/sitemap/mfb_sitemap.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_2500_followers.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_150_followers.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_no_vanity_2500_followers.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_no_vanity_150_followers.xml.gz
sitemap https://www.facebook.com/sitemap/local_business_profiles_150_followers.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_no_vanity_p_2500_followers.xml.gz
sitemap https://www.facebook.com/sitemap/profiles_no_vanity_p_150_followers.xml.gz
sitemap https://www.facebook.com/sitemap/crawled_reels_2023_07_10_crawl.xml.gz
sitemap https://www.facebook.com/sitemap/group_aggregation_pages_sitemap.xml.gz
Back to top

Comments

  • Notice: Collection of data on Facebook through automated means is
  • prohibited unless you have express written permission from Facebook
  • and may only be conducted for the limited purpose contained in said
  • permission.
  • All authorized user-agents listed on this page must comply with Meta’s
  • Automated Data Collection Terms available at:
  • https://www.facebook.com/legal/automated_data_collection_terms
Back to top