Ay i integrate with a combination of asynchronous eda

Info iconThis preview shows page 1. Sign up to view the full content.

View Full Document Right Arrow Icon
This is the end of the preview. Sign up to access the rest of the document.

Unformatted text preview: o t r e q u ir e d in tr a n s a c tio n p r o c e s s in g . nc • F r a u d d o m a in is r e q u ir e d b u t e a s ie r to m a n a g e a s s e p a r a te d e p lo y m e n t. ay ,I – Integrate with a combination of asynchronous EDA and synchronous SOA patterns. Search SOA Billing EDA EDA eB Transaction Platform Fraud 31 © 2 0 0 6 e B a y In c . eB ay ,I nc . Scaling Search Scaling Search – Overview • In 2002, eBay search had reached its limits nc . – Cost of scaling third-party search engine had become prohibitive – 9 hours to update the index – Running on largest systems vendor sold – and still not keeping up • eBay has unique search requirements – Real-time updates ,I • U p d a te ite m o n a n y c h a n g e ( lis t, b id , s a le , e tc .) – Exhaustive recall ay • U s e r s e x p e c t c h a n g e s to b e v is ib le im m e d ia te ly • S e lle r s n o tic e if s e a r c h r e s u lts m is s a n y ite m eB • S e a r c h r e s u lts r e q u ir e d a ta ( “ h is to g r a m s ” ) fr o m e v e r y m a tc h in g ite m – Flexible data storage • K e y w o rd s • S tr u c tu r e d c a te g o r ie s a n d a ttr ib u te s • No off-the-shelf product met these needs 33 © 2 0 0 6 e B a y In c . Scaling Search – Voyager • R e a l- tim e fe e d e r in fr a s tr u c tu r e – Reliable multicast from primary database to search nodes nc . • R e a l- tim e in d e x in g • In - m e m o r y s e a r c h in d e x ay • H o r iz o n ta l s e g m e n ta tio n ,I – Search nodes update index in real time from messages • C a c h in g eB – Search index divided into N slices (“columns”) – Each slice is replicated to M instances (“rows”) – Aggregator parallelizes query over all N slices, load-balances over M instances – Cache results for highly expensive and frequently used queries 34 © 2 0 0 6 e B a y In c . eB ay ,I nc . Scaling Operations Scaling Operations – Code Deployment • Demanding Requirements nc . Entire site rolled every 2 weeks...
View Full Document

This note was uploaded on 10/11/2012 for the course INFORMATIO IS taught by Professor Various during the Spring '11 term at CSU Northridge.

Ask a homework question - tutors are online