Log In Sign Up

damadam.pk
robots.txt

Robots Exclusion Standard data for damadam.pk

Resource Scan

Scan Details

Site Domain damadam.pk
Base Domain damadam.pk
Scan Status Ok
Last Scan2024-06-01T09:57:08+00:00
Next Scan 2024-06-08T09:57:08+00:00

Last Scan

Scanned2024-06-01T09:57:08+00:00
URL https://damadam.pk/robots.txt
Redirect https://damadam.pk/robots.txt/
Domain IPs 65.0.230.163
Response IP 65.0.230.163
Found Yes
Hash 847ad77b52b57fe2b2af865139c1ed44a96b46ea620fd6eca2bfc6687d34b0e5
SimHash 431887726c81

Groups

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

bidswitchbot/1.0

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

netpeakcheckerbot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

cyberalert

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

discobot

Rule Path
Disallow /

birubot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

gosospider

Rule Path
Disallow /

steeler

Rule Path
Disallow /

summify

Rule Path
Disallow /

accelobot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

*

Rule Path
Disallow /static/img/corona/

Other Records

Field Value
crawl-delay 1
Back to top

Warnings

  • 2 invalid lines.
Back to top