Log In Sign Up

local.infobel.ph
robots.txt

Robots Exclusion Standard data for local.infobel.ph

Resource Scan

Scan Details

Site Domain local.infobel.ph
Base Domain infobel.ph
Scan Status Ok
Last Scan2024-10-28T22:28:06+00:00
Next Scan 2024-11-27T22:28:06+00:00

Last Scan

Scanned2024-10-28T22:28:06+00:00
URL https://local.infobel.ph/robots.txt
Domain IPs 194.7.35.218
Response IP 194.7.35.218
Found Yes
Hash 0508f8a35643adb65d4df5915eaacb3dfe69e5e3b4d1a3a831ead46ff7bc58b0
SimHash 6065084933b1

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

*

Rule Path
Disallow */Account/Login*
Disallow */Account/Register*
Disallow */Account/ForgotPassword*
Disallow */Profile/GetDetailsReviews*
Disallow */Search/GetUpperDetailsLinks*
Disallow */Search/GetBottomLinks*
Disallow */Search/GetUpperDetailsLinksAsync*
Disallow */Search/GetBottomLinksAsync*
Disallow */Search/LoadEmailModal*
Disallow */Search/LogRevealedPhone*
Disallow */Search/GetTopCompetitors*
Disallow */Search/CategoryResults*
Disallow */Search/GetMediaFile*
Disallow */Search/LogWebsiteClick*
Disallow */Search/SetSorting*
Disallow */Search/GetSnapshotImage*
Disallow */Search/GetQRCode*
Disallow */Search/GetDataLink*
Disallow */Search/BusinessResults*
Disallow */Search/ResidentialResults*
Disallow */Search/BusinessDetails*
Disallow */Search/LoadNotifyBlockerModal*
Disallow */Packages/BusinessInfoStep*
Disallow */Packages/ChoosePackageStep*
Disallow */Packages/InvoiceStep*
Disallow */Packages/PackageCompleted*
Disallow */Packages/PaymentResponse*
Disallow */Packages/PaymentStep*
Disallow */Packages/Pricing*
Disallow */Packages/ResidentialInfoStep*
Back to top