Log In Sign Up

locale.infobel.it
robots.txt

Robots Exclusion Standard data for locale.infobel.it

Resource Scan

Scan Details

Site Domain locale.infobel.it
Base Domain infobel.it
Scan Status Ok
Last Scan2024-07-01T01:04:14+00:00
Next Scan 2024-07-31T01:04:14+00:00

Last Scan

Scanned2024-07-01T01:04:14+00:00
URL https://locale.infobel.it/robots.txt
Domain IPs 194.7.35.218
Response IP 194.7.35.218
Found Yes
Hash 08c573f55db1d99afd5f3af0a2aa48722ef0a5105af04a27628126871490d9be
SimHash 6065084933b1

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow */Account/Login*
Disallow */Account/Register*
Disallow */Account/ForgotPassword*
Disallow */Profile/GetDetailsReviews*
Disallow */Search/GetUpperDetailsLinks*
Disallow */Search/GetBottomLinks*
Disallow */Search/GetUpperDetailsLinksAsync*
Disallow */Search/GetBottomLinksAsync*
Disallow */Search/LoadEmailModal*
Disallow */Search/LogRevealedPhone*
Disallow */Search/GetTopCompetitors*
Disallow */Search/CategoryResults*
Disallow */Search/GetMediaFile*
Disallow */Search/LogWebsiteClick*
Disallow */Search/SetSorting*
Disallow */Search/GetSnapshotImage*
Disallow */Search/GetQRCode*
Disallow */Search/GetDataLink*
Disallow */Search/BusinessResults*
Disallow */Search/ResidentialResults*
Disallow */Search/BusinessDetails*
Disallow */Search/LoadNotifyBlockerModal*
Disallow */Packages/BusinessInfoStep*
Disallow */Packages/ChoosePackageStep*
Disallow */Packages/InvoiceStep*
Disallow */Packages/PackageCompleted*
Disallow */Packages/PaymentResponse*
Disallow */Packages/PaymentStep*
Disallow */Packages/Pricing*
Disallow */Packages/ResidentialInfoStep*
Back to top