Connecting to LinkedIn...

W1siziisijiwmtuvmdqvmtuvmdgvntqvmzgvnzi1l01ptlrbu0hfqkxpr19vtljftkrfukvex0lnqudfx3jlc2l6zwrfyw5kx3jlbmrlcmvklmpwzyjdlfsiccisinrodw1iiiwimtkymhgxmjuwiyjdxq

Blog

Facebook Open Sources Thrift Protocol … Again

21/02/2014 by

W1siziisijiwmtqvmtavmjgvmtuvntavndevmzkxl2zpbguixsxbinailcj0ahvtyiisijywmhg0mdbcdtawm2uixv0


After more than six years of internal development of its branch of the cross-language framework that powers its internal services, Facebook has released that branch to open source and hopes to work with the Apache Thrift community to incorporate the work.

Facebook today “re-open-sourced” the Thrift binary communication protocol with its own internal branch of Thrift, which is designed to provide a new set of core features and crank up performance.

Facebook Software Engineer Dave Watson explains that the company always wants to choose the best tools and implementations for its backend services, regardless of programming language. By using programming languages on a case-by-case basis, it can optimize performance, ease and speed of development, leverage existing libraries and so on.

“To support this practice, in 2006 we created Thrift, a cross-language framework for handling RPC [remote procedure calls], including serialization/de-serialization, protocol transport and server creation,” Watson says. “Since then, usage of Thrift at Facebook has continued to grow. Today, it powers more than 100 services used in production, most of which are written in C++, Java, PHP or Python.”

After a year of internal use, Facebook released Thrift to the open source community, where development of Apache Thrift continues. But, as Watson notes, while Apache Thrift gained wide use outside Facebook, IT organizations using it ran into performance concerns and issues separating the serialization and transport logic.

Inside Facebook, IT was running into similar issues as it gained experience running Thrift infrastructure. Watson says the team realized that Thrift was missing a core set of features, and that a lot more could be done for performance.

“For example, one issue we ran into was that internal service owners were constantly reinventing the same features again and again—such as transport compression, authentication and counters — to track the health of their servers. Engineers were also spending a lot of time trying to eke more performance from their services.”

“When Thrift was originally conceived, most services were relatively straightforward in design,” Watson adds. “A Web server would make a Thrift request to some back-end service, and the service would respond. But as Facebook grew, so did the complexity of the services. Making a Thrift request was no longer so simple. Not only did we have tiers of services (services calling other services), but we also started seeing unique future demands for each service, such as the various compression or trace/debug needs.

This article has been extracted from http://www.cio.com, please click on this link to read the article in full http://www.cio.com/article/748484/Facebook_Open_Sources_Thrift_Protocol_…_Again?taxonomyId=3020

Montash is a multi-award winning , global IT recruitment firm. Specialising in permanent and contract positions across mid-senior appointments across a wide range of industry sectors and IT functions including:

ERP, BI & Data, Information Security, IT Architecture & Strategy, Scientific Technologies, Demand IT and Business Engagement, Digital and E-commerce, Infrastructure and Service Delivery, Project and Programme Delivery.

For more information please contact us on +44 (0) 20 7014 0230 or alternatively send us an email on info@montash.com.

comments powered by Disqus

Social Stream

Latest News

W1siziisijiwmtcvmduvmjmvmtmvmjavmjkvndg3l3nodxr0zxjzdg9ja180mtqwnti1mdeuanbnil0swyjwiiwidgh1bwiilcizodb4mtawiyjdxq

Their Shoes... Matthew Gilbranch, Managing C...

2017-05-23 15:00:00 +0100

Matthew Gilbranch (32) is a managing consultant here at Montash, managing the SAP team. With 7 years in the global recruitment industry, he loves helping people and building lasting relationships with clients and candidates alike. He took the time to talk to us about what a typical day is like in the global IT recruitment industry. "I get up at 6 and I'm out of the house by half 6 and on the train by twenty to 7. On the train I tend to have a power nap ...

W1siziisijiwmtcvmduvmdqvmtyvndavmzkvotg5l3nodxr0zxjzdg9ja181ndm0mduxmtuuanbnil0swyjwiiwidgh1bwiilcizodb4mtawiyjdxq

7 Things About Your CV You Need To Fix Right ...

2017-05-04 18:00:00 +0100

As a global technology recruitment agency, we are in touch with candidates day in and day out. We've seen all kinds of CVs in our time and know a good one when we see it. As our recruitment team look to find the ideal candidate, they are looking for CVs that show how candidates can impact their clients in a positive way, not just look flashy on paper. You only have a small amount of space on your CV to show off your skills, so make every word count. Cut...