infobel.al
robots.txt

Robots Exclusion Standard data for infobel.al

Resource Scan

Scan Details

Site Domain infobel.al
Base Domain infobel.al
Scan Status Ok
Last Scan2024-06-05T08:52:19+00:00
Next Scan 2024-06-12T08:52:19+00:00

Last Scan

Scanned2024-06-05T08:52:19+00:00
URL https://infobel.al/robots.txt
Redirect https://local.infobel.al/robots.txt
Redirect Domain local.infobel.al
Redirect Base infobel.al
Domain IPs 194.7.35.240
Redirect IPs 194.7.35.218
Response IP 194.7.35.218
Found Yes
Hash 6b678fb8bc2a745c2bc20f469e6f0d9833c1e57a1c8b3ec01e9b1e88ecd008fc
SimHash 584d48493293

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow */Profile/GetDetailsReviews/*
Disallow */Search/GetUpperDetailsLinks*
Disallow */Search/GetBottomLinks*
Disallow */Search/GetUpperDetailsLinksAsync*
Disallow */Search/GetBottomLinksAsync*
Disallow */Search/LoadEmailModal*
Disallow */Search/LogRevealedPhone*
Disallow */Search/GetTopCompetitors*
Disallow */Search/GetSnapshotImage*
Disallow */Search/CategoryResults*
Disallow */Search/GetMediaFile*
Disallow */Search/LogWebsiteClick*
Disallow */Search/SetSorting*
Disallow */Search/GetQRCode*
Disallow */Search/GetDataLink*
Disallow */Search/BusinessResults*
Disallow */Search/BusinessDetails*
Disallow */Account/Register*
Disallow */Search/LoadNotifyBlockerModal*
Disallow */Account/Login*