Open Channel - Archives and Silicon Valley firm bend under rush for ...

Update, 5:40 p.m. ET: The firm at the center of today's census records meltdown says, "We were expecting a flood, but we got a tsunami."

"We had estimates of how much traffic was going to hit the site, and we did performance testing at several levels above that, but we were surprised by the traffic," Joe Godfrey, senior director of product and general manager for Inflection, a Silicon Valley database company."

Inflection was hired by the National Archives and Records Administration, which provided the 1940 census records. Inflection buiilt the search engine to serve up the records, and relied on Amazon Simple Storage Service (Amazon S3) as the cloud service provider. Inflection has been adding more of a pipeline to Amazon all day, adding the ability for more simultaneous connections, but so far searches for census records are running slowly or not running at all for many users.

The company is trying to serve up 3.8 million images of census documents, each with multiple views at different zoom levels, with each file being 10 megabytes or larger.

Godfrey said the situation has improved, and engineers are hoping by the end of today to have the situation squared away.

Earlier:

Embarrassed by a computer system that crumbled under public demand, the National Archives and Records Administration said Monday that it's working to add more servers for the release of 1940 Census records. For more users the wait to see records on family members from the Great Depression era will go on for a while longer.

The Archives had hired Inflection, a Silicon Valley database company, to run the computers, but frustrated users lit up Facebook and Twitter with complaints about images that were said to be "loading" but never arrived.

"Our testing indicated NARA and Inflection could handle the load, but 1.9 mil visitors caused issues we're working to resolve," the Archives said via Twitter. Later it added, "We'll let you know as soon as we have another update - thank you for your patience, we know it's incredibly frustrating."

Even agency officials, during the webcast to kick off the day, couldn't get images to load when they tried to look up their own relatives.

In Springfield, Ohio, Facebook user Val Lough commented on our page: "It's very sweet of them to put all of these records on line. It would be even nicer of them to make the records VISIBLE. None of them will download, I have a browser window opening that's 'loading' the documents and has been for about 20 minutes. You might want to find out what their issues are. It would be faster to mail a public records request to the National Archives." Many others are tweeting about delays.

The National Archives says it is putting more servers online to handle the crush.? At one point, the Archives said, its computers were receiving 100,000 hits per second.

Hey, you've waited 72 years to see these records, so what's another day or two.

Earlier:

A time capsule from 1940 was?opened?on Monday?at 9 a.m. ET, and we invite readers to share what they find. If you use the new records to find information about the loved or lost in your family, please post a note in the comments below or on our Open Channel page on Facebook.

U.S. Census records for individuals from April 1, 1940, protected until now by a 72-year privacy law, are now public?for the first time, revealing details about millions of Americans from that day, as the country lingered in a Great Depression,?still a year away from entry into?war in?Europe and the Pacific.

"I'm so excited!" Gary Robert Del Carlo of Martinsburg, W.Va., posted on?Facebook. "Maybe for the first time ever, I'll be able to find out something about my father. All I have is my birth certificate with his name, date of birth, state born in, and that he was in the Army stationed in Washington State. His military records burned up in St. Louis in a fire in 1973. They would have told me a lot. Wrote for his birth certificate, and there was no records of his birth. I have done nothing but hit brick walls every which way I turn. I'm praying I find something useful tomorrow, anything."

---

NPR describes the release as the "Super Bowl for Genealogists." Librarians around the country are ready to provide assistance.?At the Family History Library in Salt Lake City, the staff will be serving cake and providing help.

?

When the 120,000 census takers?counted 132,164,569 people living in the country on that day, the information collected included the address, whether the house was owned or rented, value of the home or monthly rent, is it considered a farm, names of adults and children, familiy relationships, sex, race, age, place of birth, citizenship, residence five years earlier, education. And for a small subset of people, about 5 percent, they were asked about?place of birth of mother and father, language spoken in the home as a child, veteran status, wars served in, Social Security status, occupation, employment status, occupation, number of weeks worked in 1939, income and, for women,?whether they?had been married more than once, age at first marriage, and number of children ever born.

There is a catch.?As the records go online, they can't be searched by name. For a city it's helpful to know an exact address, but often you can work with a neighborhood (near the corner of Canal and Varrick streets in New York City). Your public library may have old city directories or telephone directories from that period, allowing?you to look up people by name to find an address. For a rural area, you need to know at least the county and the name of the town or township.

Genealogists, librarians and volunteers will begin the work of indexing the records,?which eventually will allow searches?by name. Two sites, the commercial Ancestry.com and the Mormon Church's FamilySearch.org, have announced plans to provide indexes to their customers as quickly as possible, with some images going online on Monday.?FamilySearch and Ancestry.com started putting images from the Census files?online early on Monday, but for now without a name index.?

For now,?you must know at least an approximate address to get started. You use that address to find an "enumeration district," which in a big city might be only a few?blocks, and would be a larger area in a small town.

Another approach, for those interested in a specific place, is to look at all the records for your block or street. If your area was settled in 1940, who lived there then, and what were their lives like?

Your goal: With that district number, you can look on the Census website at the online copy of the form filled out by the census taker in 1940. In 70 years, it has gone from paper to microfilm to computer.

Here are resources to help you with the search (links open in a new window), though as with most things in life, the key is: Ask a librarian.

?

cloudy with a chance of meatballs the hobbit movie hanukkah gpa calculator menorah chanukah chanukah