dpaulsonline.com
robots.txt

Robots Exclusion Standard data for dpaulsonline.com

Resource Scan

Scan Details

Site Domain dpaulsonline.com
Base Domain dpaulsonline.com
Scan Status Ok
Last Scan2024-05-08T18:45:52+00:00
Next Scan 2024-06-07T18:45:52+00:00

Last Scan

Scanned2024-05-08T18:45:52+00:00
URL https://dpaulsonline.com/robots.txt
Redirect http://www.dpaulsonline.com/robots.txt
Redirect Domain www.dpaulsonline.com
Redirect Base dpaulsonline.com
Domain IPs 104.21.72.224, 172.67.187.208, 2606:4700:3032::ac43:bbd0, 2606:4700:3036::6815:48e0
Redirect IPs 104.21.72.224, 172.67.187.208, 2606:4700:3032::ac43:bbd0, 2606:4700:3036::6815:48e0
Response IP 172.67.187.208
Found Yes
Hash 25d3931812f5b25814e0838b9ab5e2f622a13588fc5fbf94aa895676856e1d2e
SimHash 4c555f9613f5

Groups

psbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

*

Rule Path
Disallow /App_Browsers
Disallow /App_Code
Disallow /App_Data
Disallow /App_GlobalResources
Disallow /App_WebReferences
Disallow /Bin
Disallow /fonts
Disallow /attachments
Disallow /mailcontent
Disallow /pdf
Disallow /elmah.axd
Disallow /custom_error.aspx
Disallow /makepayment.aspx
Disallow /homepageshtml
Disallow /WebResource.axd
Disallow /ScriptResource.axd
Disallow /confirmation.aspx
Disallow /crazydeals.aspx
Disallow /dpaulscrazydeals.aspx
Disallow /dpaulspayment.aspx
Disallow /emptycart.aspx
Disallow /gatewayfailureresponse.aspx
Disallow /GatewayResponse.aspx
Disallow /flights
Disallow /flights-hotels
Disallow /login.aspx
Disallow /offers/
Disallow /offer/
Disallow /disneyland/iframe.html/
Disallow /disneyland/iframe_en.html/
Disallow /logs/123logreport.htm
Disallow /mailers
Disallow /pg
Disallow /ads
Disallow /packagethemes
Disallow /offpaymentresponse.aspx
Disallow /servicenotfound.aspx
Disallow /sendenquiry.aspx
Disallow /europe1_details.html/
Disallow /singapore2_details.html/
Disallow /kerala.php/
Disallow /profile.php/
Disallow /northeast.php/
Disallow /utilityservices.svc/
Disallow /monterey/
Disallow /0/
Disallow /intc/
Disallow /intc/*
Disallow /intc
Allow /fly-n-stay

Warnings

  • 13 invalid lines.