alwaysthevip.com
robots.txt

Robots Exclusion Standard data for alwaysthevip.com

Resource Scan

Scan Details

Site Domain alwaysthevip.com
Base Domain alwaysthevip.com
Scan Status Ok
Last Scan2025-04-25T08:27:43+00:00
Next Scan 2025-05-02T08:27:43+00:00

Last Scan

Scanned2025-04-25T08:27:43+00:00
URL https://alwaysthevip.com/robots.txt
Redirect https://www.alwaysthevip.com/robots.txt
Redirect Domain www.alwaysthevip.com
Redirect Base alwaysthevip.com
Domain IPs 2a02:4780:84:3899:a989:1a75:da48:7ef7, 84.32.84.0
Redirect IPs 2a02:4780:39:a64d:8be0:787f:9313:b087, 84.32.84.191
Response IP 93.127.201.238
Found Yes
Hash bd757141b0aac8dc652d95e476589944b63e8e04f7c330f2b958c3d08deae0c1
SimHash 5220890289b3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/uploads/wpo-plugins-tables-list.json
Allow /wp-admin/admin-ajax.php

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

botify

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.alwaysthevip.com/sitemap_index.xml