How to Test a URL for 404 error in PHP?

In PHP, testing a URL for 404 errors is essential for validating links and ensuring proper user experience. PHP offers several methods to check URL status codes, each with different levels of efficiency and control.

Using file_get_contents()

The simplest approach uses file_get_contents() with a custom stream context to handle errors gracefully ?

<?php
function isUrlValid($url) {
    // Disable error reporting for file_get_contents
    $context = stream_context_create(['http' => ['ignore_errors' => true]]);
    
    // Fetch the URL content
    $content = file_get_contents($url, false, $context);
    
    // Get the response headers
    $headers = $http_response_header;
    
    // Check if the response code contains "404"
    foreach ($headers as $header) {
        if (stripos($header, 'HTTP/1.1 404') !== false) {
            return false; // URL returns a 404 error
        }
    }
    return true; // URL is valid
}

// Usage
$url = "http://example.com/nonexistent-page";
if (isUrlValid($url)) {
    echo "URL is valid.";
} else {
    echo "URL returns a 404 error.";
}
?>

This method creates a stream context with ignore_errors set to true, preventing PHP from throwing warnings on HTTP errors. The $http_response_header variable is automatically populated with headers from the last HTTP request.

Using get_headers()

A more efficient approach using get_headers() to fetch only headers without downloading the entire page content ?

<?php
function isUrlValid($url) {
    // Create a stream context with "ignore_errors" set to true
    $context = stream_context_create(['http' => ['ignore_errors' => true]]);
    
    // Fetch the URL headers
    $headers = get_headers($url, 0, $context);
    
    // Check if the first header contains "404"
    if (strpos($headers[0], '404') !== false) {
        return false; // URL returns a 404 error
    }
    return true; // URL is valid
}

// Usage
$url = "http://example.com/missing-page";
if (isUrlValid($url)) {
    echo "URL is valid.";
} else {
    echo "URL returns a 404 error.";
}
?>

The get_headers() function retrieves only HTTP headers, making it faster than downloading full content. The first element $headers[0] contains the HTTP status line.

Using cURL with HEAD Request

The most robust approach uses cURL with CURLOPT_NOBODY to send efficient HEAD requests ?

<?php
function isUrlValid($url) {
    // Initialize cURL session
    $ch = curl_init($url);
    
    // Set the CURLOPT_NOBODY option to send a HEAD request
    curl_setopt($ch, CURLOPT_NOBODY, true);
    
    // Set CURLOPT_RETURNTRANSFER option to receive the response as a string
    curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
    
    // Set timeout to avoid hanging
    curl_setopt($ch, CURLOPT_TIMEOUT, 10);
    
    // Execute the request
    curl_exec($ch);
    
    // Get the response code
    $responseCode = curl_getinfo($ch, CURLINFO_HTTP_CODE);
    
    // Close cURL session
    curl_close($ch);
    
    // Check if the response code is 404
    return $responseCode !== 404;
}

// Usage
$url = "http://example.com/404-page";
if (isUrlValid($url)) {
    echo "URL is valid.";
} else {
    echo "URL returns a 404 error.";
}
?>

Comparison

Conclusion

For production applications, use cURL with HEAD requests for optimal performance. The get_headers() method offers a good balance between simplicity and efficiency, while file_get_contents() works best for basic validation needs.