facebook.com
robots.txt
Robots Exclusion Standard data for facebook.com
Resource Scan
Scan Details
Site Domain | facebook.com |
Base Domain | facebook.com |
Scan Status | Ok |
Last Scan | 2024-10-25T05:33:39+00:00 |
Next Scan | 2024-11-08T05:33:39+00:00 |
Last Scan
Scanned | 2024-10-25T05:33:39+00:00 |
URL | https://facebook.com/robots.txt |
Domain IPs | 157.240.13.35, 2a03:2880:f10c:381:face:b00c:0:25de |
Response IP | 157.240.235.35 |
Found | Yes |
Hash | dac243c437f3e572c9a7b1700d6582e5189de0f0919ab9bf76711e5923b805cc |
SimHash | 7855d10466b5 |
Groups
applebot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
bingbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
discordbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
duckduckbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
googlebot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
googlebot-image
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /map_tile.php |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /static_map.php |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
googlebot-video
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
googlebot-news
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
google-inspectiontool
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
linkedinbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
msnbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
naverbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
pinterestbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
screaming frog seo spider
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
seznambot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
slurp
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
teoma
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
telegrambot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
twitterbot
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
yeti
Rule | Path |
---|---|
Disallow | /*/plugins/* |
Disallow | /?*next= |
Disallow | /a/bz? |
Disallow | /ajax/ |
Disallow | /album.php |
Disallow | /checkpoint/ |
Disallow | /contact_importer/ |
Disallow | /dialog/ |
Disallow | /fbml/ajax/dialog/ |
Disallow | /feeds/ |
Disallow | /file_download.php |
Disallow | /job_application/ |
Disallow | /l.php |
Disallow | /login.php*%26next%3D |
Disallow | /login.php/?next= |
Disallow | /login.php?next= |
Disallow | /login/*%26next%3D |
Disallow | /login/?next= |
Disallow | /login/device-based/regular/login/*%26next%3D |
Disallow | /login/device-based/regular/login/?next= |
Disallow | /moments_app/ |
Disallow | /p.php |
Disallow | /photos.php |
Disallow | /plugins/ |
Disallow | /share.php |
Disallow | /share/ |
Disallow | /sharer.php |
Disallow | /sharer/ |
Disallow | /tr/ |
Disallow | /tr? |
Disallow | /ufi/reaction/profile/browser/ |
Disallow | /x/oauth/ |
Allow | /ajax/bootloader-endpoint/ |
Allow | /ajax/pagelet/generic.php/PagePostsSectionPagelet |
Allow | /careers/ |
Allow | /safetycheck/ |
*
Rule | Path |
---|---|
Disallow | / |
Comments