profitserver.net
robots.txt

Robots Exclusion Standard data for profitserver.net

Resource Scan

Scan Details

Site Domain profitserver.net
Base Domain profitserver.net
Scan Status Ok
Last Scan2025-07-20T11:47:07+00:00
Next Scan 2025-08-19T11:47:07+00:00

Last Scan

Scanned2025-07-20T11:47:07+00:00
URL https://profitserver.net/robots.txt
Domain IPs 104.21.22.194, 172.67.206.224, 2606:4700:3031::6815:16c2, 2606:4700:3034::ac43:cee0
Response IP 172.67.206.224
Found Yes
Hash 108a6fa94464d2831c4ba4d1e276d613018c79cdf77bb67bf1ee8162440a863a
SimHash 455cd411f285

Groups

*

Rule Path
Disallow /wp-admin
Disallow /*?
Disallow /?
Allow /*?partner_id=
Disallow /*.php
Disallow /files/*.html
Disallow /cdn-cgi/

yandex

Rule Path
Disallow /wp-admin
Disallow /*?
Disallow /?
Allow /*?partner_id=
Disallow /*.php
Disallow /files/*.html
Disallow /cdn-cgi/

ahrefsbot
backupland
baiduspider
barkrowler
bdc
bingbot
bytespider
coccocbot-image
coccocbot-web
dataforseobot
dotbot
iaskbot
imagesiftbot
mj12bot
pageburst
petalbot
semrushbot
seznambot
slurp
tiktokspider
uptimerobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://profitserver.net/sitemap_index.xml
sitemap https://profitserver.net/post-sitemap.xml
sitemap https://profitserver.net/page-sitemap.xml
sitemap https://profitserver.net/sitemap_index.xml
sitemap https://profitserver.net/post-sitemap.xml
sitemap https://profitserver.net/page-sitemap.xml

Warnings

  • `clean-param` is not a known field.