netflix.com
robots.txt

Robots Exclusion Standard data for netflix.com

Resource Scan

Scan Details

Site Domain netflix.com
Base Domain netflix.com
Scan Status Ok
Last Scan2024-05-04T17:20:13+00:00
Next Scan 2024-05-18T17:20:13+00:00

Last Scan

Scanned2024-05-04T17:20:13+00:00
URL https://netflix.com/robots.txt
Redirect https://www.netflix.com/robots.txt
Redirect Domain www.netflix.com
Redirect Base netflix.com
Domain IPs 2600:1f14:62a:de83:c61a:d6e:18b0:65f7, 2600:1f14:62a:de84:880a:88cc:a16:5423, 2600:1f14:62a:de85:d7:e7a1:8f7d:f6f5, 44.240.158.19, 44.242.13.161, 52.38.7.83
Redirect IPs 2600:1f14:62a:de83:c61a:d6e:18b0:65f7, 2600:1f14:62a:de84:880a:88cc:a16:5423, 2600:1f14:62a:de85:d7:e7a1:8f7d:f6f5, 44.234.232.238, 44.237.234.25, 44.242.60.85
Response IP 52.38.7.83
Found Yes
Hash b87f64f056f2c8711a4fc63ee87ea9f41c6f26c06fb5fc349bf2eaf1fdd729fd
SimHash aef77b30cbb7

Groups

*

Rule Path
Disallow /

googlebot
googlebot-video
applebot
bingbot
baiduspider
baiduspider-mobile
baiduspider-video
baiduspider-image
naverbot
y!j-wsc
yj-wsc
yeti
yandex
yandexbot
yandexmobilebot
yandexvideo
yandexwebmaster
yandexsitelinks
seznambot

Rule Path
Allow /
Disallow /accountstatus
Disallow /AccountStatus
Disallow /aui/inbound
Disallow /authenticate
Disallow /autologin
Disallow /clearcookies
Disallow /companies
Disallow /editpayment
Disallow /emailunsubscribe
Disallow /error
Disallow /eula
Disallow /geooverride
Disallow /help
Disallow /imagelibrary
Disallow /learnmorelayer
Disallow /learnmorelayertv
Disallow /login
Disallow /loginhelp
Disallow /loginhelp/lookup
Disallow /loginhelpsucess
Disallow /LoginHelp
Disallow /password
Disallow /logout
Disallow /Logout
Disallow /mcd
Disallow /modernizr
Disallow /n/
Disallow /notamember
Disallow /notfound
Disallow /notices
Disallow /nrdapp
Disallow /optout
Disallow /overviewblockseeother
Disallow /popup/codewhatisthis
Disallow /popupdetails
Disallow /PopupDetails
Disallow /popupprivacypolicy
Disallow /privacypolicychanges
Disallow /registration
Disallow /rememberme
Disallow /signout
Disallow /signurl
Disallow /subscriptioncancel
Disallow /tastesurvey
Disallow /termsofusechanges
Disallow /tvsignup
Disallow /upcomingevents
Disallow /verifyidentity
Disallow /whysecure
Disallow /arabic
Disallow /Arabic
Disallow /chinese
Disallow /Chinese
Disallow /korean
Disallow /Korean
Disallow /airtel
Disallow /anan
Disallow /bouyguestelecom
Disallow /britishairways
Disallow /brutus
Disallow /comhem
Disallow /courts
Disallow /csl
Disallow /elisa
Disallow /entertain
Disallow /FireTV
Disallow /firetv
Disallow /freemonth
Disallow /kpn
Disallow /lg
Disallow /maxis
Disallow /Maxis
Disallow /meo
Disallow /Meo
Disallow /orangefrance
Disallow /Panasonic
Disallow /panasonic
Disallow /playstation
Disallow /proximus
Disallow /qantas
Disallow /samsung
Disallow /Sony
Disallow /sony
Disallow /talktalk
Disallow /tdc
Disallow /telenor
Disallow /telfort
Disallow /tim
Disallow /virginaustralia
Disallow /vodafone
Disallow /vodafonedemobilelaunch
Disallow /xboxone
Disallow /xfinity
Disallow /xs4all
Disallow /ziggo
Disallow /accountaccess
Disallow /AccountAccess
Disallow /activate
Disallow /Activate
Disallow /BillingActivity
Disallow /browse
Disallow /browse/*
Allow /browse/genre/*
Disallow /CancelPlan
Disallow /ChangePlan
Disallow /changeplan
Disallow /deviceManagement
Disallow /DoNotTest
Disallow /EditProfiles
Disallow /email
Disallow /EmailPreferences
Disallow /entrytrap
Disallow /HdToggle
Disallow /LanguagePreferences
Disallow /ManageDevices
Disallow /ManageProfiles
Disallow /MoviesYouveSeen
Disallow /NewWatchInstantlyRSS
Disallow /NewWatchInstantlyRSS/*
Disallow /payment
Disallow /Payment
Disallow /phonenumber
Disallow /pin
Disallow /profiles
Disallow /profiles/*
Disallow /ProfilesGate
Disallow /search
Disallow /search/*
Disallow /viewingactivity
Disallow /WiViewingActivity
Disallow /yourAccount
Disallow /youraccount
Disallow /YourAccount
Disallow /YourAccountPayment

adsbot-google
twitterbot
adidxbot

Rule Path
Allow /

yahoo pipes 1.0
facebot
externalfacebookhit

Rule Path
Disallow /
Allow /tudum