Skip to main content

Broken Link Reasons

DubBot reports each broken link with a Reason, usually the HTTP status code the link returned. Links with an HTTP_404 Reason should usually be fixed first.

When a link is clicked, a web browser will receive a status code and display content based on the status code.

DubBot allows users to Exclude Broken Links by Reason. Most Reasons DubBot reports are HTTP status codes of 400 or greater.

DubBot uses bot technology to automate the testing of broken links. In some cases, web servers and some web pages have been programmed to refuse connection to a bot.

Often these pages will return a 401 (Unauthorized) or 403 (Forbidden) status code. While this information could be useful to some users, it may overwhelm reporting and action on actual issues. For these users, DubBot allows for filtering by Reason.

The following Reasons are enabled by default in DubBot.

  • HTTP_400: Bad Request > server cannot process the request due to bad syntax, invalid request message framing, sometimes password needed

  • HTTP_401: Unauthorized > page is password protected

  • HTTP_402: Payment Required

  • HTTP_403: Forbidden > insufficient permissions to access this page

  • HTTP_404: Not Found > the requested resource is missing - either it is missing or there is an error in the URL

  • HTTP_405: Method Not Allowed > web server for the link does not like the method of the get or head request being made. Our Broken Link Checker uses head requests by default - this can be switched to work with your server, contact support. We can also ignore links in those domains using a regex, if having an audit list of ignored links is not important for your account.

  • HTTP_406: Not Acceptable > link destination only generates responses DubBot does not accept

  • HTTP_407: Proxy Authentication Required > similar to 401, authentication required

  • HTTP_408: Request Timeout > DubBot timed out while waiting for a reply from the server

  • HTTP_409: Conflict > or invalid state, cannot be completed

  • HTTP_410: Gone > resource has been deliberately removed and is not expected to return, stronger than a 404

  • HTTP_411: Length Required

  • HTTP_412: Precondition Failed > server does not meet one or more pre-conditions

  • HTTP_413: Content Too Large

  • HTTP_414: URI Too Long

  • HTTP_415: Unsupported Media Type

  • HTTP_416: Range Not Satisfiable

  • HTTP_417: Expectation Failed

  • HTTP_418: I'm a Teapot > leftover April Fool's joke that is used by some for requests they don't want to handle

  • HTTP_420: Enhance Your Calm (Twitter)

  • HTTP_421: Misdirected Request

  • HTTP_422: Unprocessable Content

  • HTTP_423: Locked

  • HTTP_424: Failed Dependency

  • HTTP_425: Too Early

  • HTTP_426: Upgrade Required

  • HTTP_428: Precondition Required

  • HTTP_431: Request Header Fields Too Large

  • HTTP_440: Login Time-out (IIS specific)

  • HTTP_444: No Response (nginx)

  • HTTP_449: Retry With (IIS)

  • HTTP_450: Blocked by Windows Parental Controls

  • HTTP_451: Unavailable For Legal Reasons

  • HTTP_460: Client closed connection prematurely (AWS ELB)

  • HTTP_463: Too many forwarded IP addresses (AWS ELB)

  • HTTP_464: Incompatible protocol (AWS ELB)

  • HTTP_494: Request header too large (nginx)

  • HTTP_495: SSL Certificate Error (nginx)

  • HTTP_496: SSL Certificate Required (nginx)

  • HTTP_497: HTTP Request Sent to HTTPS Port (nginx)

  • HTTP_498: Invalid Token (Esri)

  • HTTP_499: Client Closed Request (nginx)

  • ERRNO_EPROTO: Protocol error (older link checker only)

  • BLC_TOO_MANY_REDIRECTS: too many redirects encountered

The following Reasons are disabled by default in DubBot, meaning they will not be reported:

  • HTTP_429: Too Many Requests > can happen if too many requests are sent in a given time

  • HTTP_500: Internal Server Error

  • HTTP_501: Not Implemented

  • HTTP_502: Bad Gateway

  • HTTP_503: Service Unavailable > can happen when server is busy or needs repair

  • HTTP_504: Gateway Timeout

  • HTTP_505: HTTP Version Not Supported

  • HTTP_506: Variant Also Negotiates

  • HTTP_507: Insufficient Storage

  • HTTP_508: Loop Detected

  • HTTP_509: Bandwidth Limit Exceeded

  • HTTP_510: Not Extended

  • HTTP_511: Network Authentication Required

  • HTTP_520 to HTTP_530: shown as HTTP 5xx (no label)

  • ERRNO_ECONNREFUSED: Connection refused

  • ERRNO_ECONNRESET: Remote host reset the connection request

  • ERRNO_EMFILE: Too many open files (older link checker only)

  • ERRNO_ENOTFOUND: No matching DNS record found

  • ERRNO_ETIMEDOUT: Connection timed out

  • BLC_CUSTOM: Custom Exclusion

  • BLC_EXTERNAL: External URL Exclusion

  • BLC_HTML: HTML Exclusion

  • BLC_INTERNAL: Internal URL Exclusion

  • BLC_INVALID: Invalid URL

  • BLC_KEYWORD: Keyword Exclusion

  • BLC_ROBOTS: Robots Exclusion

  • BLC_SAMEPAGE: Same-page URL Exclusion

  • BLC_SCHEME: Scheme Exclusion

  • BLC_UNKNOWN: Unknown Error

Find more detailed information on HTTP Response Status Codes from MDN web docs.

If you have questions, please contact our DubBot Support team via email at help@dubbot.com or via the blue chat bubble in the lower right corner of your screen. We are here to help!

Did this answer your question?