Log In Sign Up

getdating24.com
robots.txt

Robots Exclusion Standard data for getdating24.com

Resource Scan

Scan Details

Site Domain getdating24.com
Base Domain getdating24.com
Scan Status Ok
Last Scan2025-11-01T00:01:19+00:00
Next Scan 2025-12-01T00:01:19+00:00

Last Scan

Scanned2025-11-01T00:01:19+00:00
URL https://getdating24.com/robots.txt
Domain IPs 37.1.223.102
Response IP 37.1.223.102
Found Yes
Hash 98017a1c44f0d2e18bcf9b3350a15679c77b8e31e1d036257f72b93d2baf6918
SimHash 19347161561a

Groups

googlebot
googlebot-mobile
googlebot-image
googlebot-news
googlebot-video
bingbot
slurp
duckduckbot
baiduspider
yandex
yandexbot
yandeximages
mail.ru
seznambot
sogou
exabot
facebot
facebookexternalhit
twitterbot
linkedinbot
applebot

Rule Path
Allow */uploads
Disallow /cgi-bin
Disallow /?
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow */wlwmanifest.xml
Disallow /xmlrpc.php
Disallow *utm*%3D
Disallow *openstat%3D

gptbot
chatgpt-user
google-extended
claudebot
claude-web
perplexitybot
perplexityai
cohere-ai
aibot
ai2bot
facebookbot
anthropic-ai
openai
applebot-extended
amazonbot
ccbot
dataforseobot
ia_archiver

Rule Path
Disallow /

ahrefsbot
semrushbot
mj12bot
dotbot
blexbot
mauibot
siteauditbot
seokicks-robot
rogerbot
megaindex.ru
spbot
aspiegelbot
domaincrawler
rankactivelinkbot
rankactivechecker
rankactivelinkbot
xovibot
lcc
archive.org_bot
siteexplorer
velenpublicwebcrawler
zoominfobot
ezooms
wotbox
proximic
sistrix
linkpadbot
screaming frog seo spider
uptimerobot
boardreader
mail.ru_bot
istellabot
james bot
obot
barkrowler
yisouspider
serendeputybot
embedly
domaincrawler
ai-powered-crawler

Rule Path
Disallow /

googlebot-image

Rule Path
Allow */uploads

yandeximages

Rule Path
Allow */uploads
Back to top

Other Records

Field Value
sitemap https://getdating24.com/sitemap.php
Back to top

Warnings

  • 1 invalid line.
Back to top