Apache doesn't cache htaccess configs

February 5th, 2013
When I previously suggested that Apache improve performance on .htaccess files by caching them and then watching for changes with inotify, Chris wrote:
just invalidate its cache
This is very sensible, except Apache doesn't actually cache .htaccess files between requests.

Apache checks .htaccess files in a monster function, ap_directory_walk. It's called on every request, and if AllowOverride is set it will call ap_parse_htaccess on every directory from the root out to the leaf. In ap_parse_htaccess you can see that it does have a per-request cache for parsed .htaccess files:

    /* firstly, search cache */
    for (cache = r->htaccess; cache != NULL; cache = cache->next) {
        if (cache->override == override && strcmp(cache->dir, d) == 0) {
            *result = cache->htaccess;
            return OK;

    ... more sanity and safety checks ...

    dc = ap_create_per_dir_config(r->pool);

    ... load and parse the htaccess file into dc ...

    /* cache it */
    new = apr_palloc(r->pool, sizeof(struct htaccess_result));
    new->dir = parms.path;
    new->override = override;
    new->override_opts = override_opts;
    new->htaccess = dc;

    /* add to head of list */
    new->next = r->htaccess;
    r->htaccess = new;

    return OK;

Now it may be that the overhead of parsing .htaccess files just isn't that big and that in many cases a cache would just be a waste of memory. While I doubt that, this is testable. To get a best-case for caching we could test just something like:

Comparing this to the version that has the configuration options in a <Directory> block should tell us the maximum we could expect to gain from caching.

Update 2013-02-08: I ran some tests on the above configuration with ab, but the variance was so extreme (some runs of 10k requests averaged 4k/s while others averaged 500/s) that I think something else is wrong. I tried running longer tests with more requests but ab consistently died with apr_socket_recv: Operation timed out (60) before finishing the test.

Comment via: google plus, facebook

Recent posts on blogs I like:

On The Prosperity Gospel

things I find fascinating: religion, scams

via Thing of Things February 19, 2024

Diseconomies of scale in fraud, spam, support, and moderation

If I ask myself a question like "I'd like to buy an SD card; who do I trust to sell me a real SD card and not some fake, Amazon or my local Best Buy?", of course the answer is that I trust my local Best Buy1 more than Amazon, which is notoriou…

via Posts on February 18, 2024

Raising children on the eve of AI

How do we prepare them for what we're not prepared for? The post Raising children on the eve of AI appeared first on Otherwise.

via Otherwise February 15, 2024

more     (via openring)