• Posts
  • RSS
  • ◂◂RSS
  • Contact

  • Googlebot Running Javascript

    January 11th, 2012
    tech  [html]
    If you search Google for site:www.jefftk.com [1], the sixth result is currently:
    The text it's showing for the description is from a comment. This is strange, because the comments from my posts are pulled in from from Facebook and Google Plus via javascript. So in the indexing process Google is running this script on another server, computing the change to the page that the "document.write" makes, and saving the text as the post-javascript page.

    I can see how in the modern javascript-everywhere web this helps people get better search results, but this feels erie. It's a violation of how I expect bots to work. Next we'll see Google having indexed pages that require form submissions to get to.

    Update 2012-01-11: The example above of javascript is from a Google+ comment, and while I think it's unlikely that Google is using G+ comments on link shares to pull up results, to test this I checked whether it also could pull things out of Facebook comments. It can:


    [1] Why was I doing this? I recently added a <meta name="description" content="[first 400 characters of post]" /> to my blog entries because Google was putting the header ("  ::  Blog Posts  ::  RSS Feed ...") into the search results and I wanted to tell it where the real text started:

    The change seems to have fixed some results but not all of them. They previously all looked like the image above, but now some are the beginning of the text, as 'description' should hint:

    Comment via: google plus, facebook

    Recent posts on blogs I like:

    Fireside Friday, November 27, 2020

    Hey folks! Fireside this week. A bit of a change-up in terms of the coming attractions. I had planned to start “Textiles, How Did They Make It?” next, but I want to do a bit more reading on some of the initial stages of textile production (that is, the pr…

    via A Collection of Unmitigated Pedantry November 27, 2020

    Building Depth and Window Space

    How much window space does an apartment need, relative to its area, and how does this affect building style? A fascinating post from about a year ago on Urban Kchoze makes the argument that modern North American buildings are too deep – Simon calls them o…

    via Pedestrian Observations November 27, 2020

    Thoughts you mightn't have thunk about remote meetings

    Welcome to this week's edition of "building a startup in 2020," in which all your meetings are suddenly remote, and you probably weren't prepared for it. I know I wasn't. We started a "fully remote" company back in 2019, but …

    via apenwarr November 23, 2020

    more     (via openring)


  • Posts
  • RSS
  • ◂◂RSS
  • Contact