nitter.ca
robots.txt

Robots Exclusion Standard data for nitter.ca

Resource Scan

Scan Details

Site Domain nitter.ca
Base Domain nitter.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-02-12T02:57:54+00:00
Next Scan 2025-04-13T02:57:54+00:00

Last Successful Scan

Scanned2024-11-22T02:54:46+00:00
URL https://nitter.ca/robots.txt
Domain IPs 104.21.39.253, 172.67.172.213, 2606:4700:3030::6815:27fd, 2606:4700:3037::ac43:acd5
Response IP 104.21.39.253
Found Yes
Hash 89d26bd3f40382b9032220febaca7441cca07965b713a2e7ceabfc1bceab32ab
SimHash a20d0120e3a2

Groups

massdownloader

Rule Path
Disallow /

pandalytics

Rule Path
Disallow /

libweb

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

serpstat

Rule Path
Disallow /

mercator

Rule Path
Disallow /

wildsoftsurfer

Rule Path
Disallow /

joc

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

thenomad

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

npbot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

frontpage

Rule Path
Disallow /

yeti

Rule Path
Disallow /

jocwebspider

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

netzip

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /feeds/TechNet/fr-fr/screenshot/screenshot%20surface.jpg
Disallow /*/newsearch/
Allow /wp-admin/admin-ajax.php