Performance testing with data representative of production.

Lot of times applications are certified for good performance by testing with minimal data. The performance tests should be done with a data set which is representative of the production environment. One needs to load the peak expected data as per the data retention scheme employed in the performance test environment and validate the performance. The performance results can vary significantly for different size of the data incorporated in the database.

For example a particular query might be doing a full table scan and this issue might not be noticed when testing with small amounts of data. When it goes into production and there is substantial amount of data, this single query can bring down the performance of the whole solution to its knees. This single query could eat up the CPU of the database machine thereby adversely affecting all the other queries. The time to find out the root cause of this issue while the product is in production could be substantial and the customer impact could be huge. There might be need to optimize your database configuration ( SGA size, tablespace settings, redo log settings, archival settings etc.)  in order to support huge amounts of data. Some of your queries would be using complex joins and dealing with large number of records and could impact performance. All these issues could be found and resolved prior to going in production by running performance tests with production like data.

In a recent consulting work I was involved in a project where not much thought was put into data retention. There was actually no data retention strategy. The application was dealing with large amounts of data and was retaining the data in the live database and would grow to 15 TB in just a few months. There is no way we could test with this kind of data and also there was no storage immediately available to handle this kind of data. Actually there was no need of storing all this data in the live database. All that was required was an archiving strategy. The data (documents) would only be looked into if there was some issue so there was no need to keep it in live database, also there was a downstream system which would do most of the processing and it would be safe to archive the data if the processing was successful.  In this case it was an architecture issue and just required an archival strategy.

Also another challenge is to upload huge amounts of data for performance testing  especially if it is the first release and there is not production data available. There is a need to generate huge amounts of data. Should you use the performance load tool to drive the load and create the data? I would advise against that. It might take whole lot of time just to populate the database especially if you drive from the front end and go through the whole solution. If possible one should use some kind of script to directly load data in the database and bypass the whole solution and speed up the process.

Share/Save/Bookmark

Tags: , , , , , , , ,

40 Responses to “Performance testing with data representative of production.”

  1. Jeremy Osthoff Says:

    Usually Gideon drops his head when he gives up TDs like that. Wonder what’s up.

  2. medical negligence law Says:

    Hey I know this is off topic but I was wondering if you
    knew of any widgets I could add to my blog that automatically tweet my
    newest twitter updates. I’ve been looking for a plug-in like this
    for quite some time and was hoping maybe you would have some experience with something
    like this. Please let me know if you run into anything.
    I truly enjoy reading your blog and I look forward to your new updates.

    my blog – medical negligence law

  3. car carpet cleaner Victoria BC Says:

    I leave a leave a response each time I appreciate a post on a website or if I have something
    to valuable to contribute to the discussion. Usually it’s caused by
    the fire communicated in the article I read.
    And after this article Performance testing with data representative of
    production. | eSustain. I was actually moved enough to
    leave a comment :-) I actually do have a couple of questions for you if
    it’s okay. Is it just me or do a few of these comments look
    as if they are written by brain dead people? :-P And, if you are writing at other online sites, I would
    like to follow anything fresh you have to post. Would you list every one
    of all your shared sites like your linkedin profile,
    Facebook page or twitter feed?

    Take a look at my website … car carpet cleaner Victoria BC

  4. private jet rental Says:

    What’s up colleagues, its fantastic article on the topic of teachingand entirely
    explained, keep it up all the time.

    Stop by my weblog – private jet rental

  5. car carriers Says:

    Spot on with this write-up, I truly feel this website needs far
    more attention. I’ll probably be returning to read through
    more, thanks for the advice!

    Stop by my website car carriers

  6. tv amr Says:

    I reckon you see something brand-new everyday. Regards, Murray Roper

  7. http://www.ballooncms.com/index.php?itemid=31 Says:

    I believe everything typed made a bunch of sense. However, consider this, suppose you typed a catchier title?
    I ain’t saying yoiur information is not good,
    but what if you added a title that makes people desire more?
    I mean Performance testing with data representative off production. | eSustaain is
    a little vanilla. You should peek at Yahoo’s front page aand waatch how they create news titles to get people to open the links.
    You might try adding a video or a pic or two
    to get people intereste about everything’ve got too say.
    In my opinion, it could bring your posts a little livelier.

  8. seo Says:

    Especialistas en marketing click here de Internet cristiana.
    Cuando quieres entrar a un gran fotógrafo. También puede mantener en los buscadores.

    No se puede entender, solo lo ven como un modo de captar nuevos clientes.

    Con la globalización y los chats online. Usted puede tener buenas intenciones, pero click here usted
    debe estar seguro de que comience. 2 El esfuerzo y la información en un buscador y no
    en otro 50% su popularidad. Si usted comienza a recibir un buen contenido y no tienen que invertir en centros de información creíble.

  9. Vollständiger Artikel Says:

    Der junge Jäger reisst das Gewehr hoch, aber der alte drückt es ihm wieder nach unten: Nein, nicht auf den, der ist noch zu !

  10. zoey 101 porno Says:

    Wir haben Sexkontaktanzeigen aus Bundesländern.

  11. get more info Says:

    Am I correct?

  12. バッグ,CELINE セリーヌ,セリーヌ新作,CHANEL シャネル,COCOバッグ,キャンバストートバッグ,CHLOE クロエ,クロエ新作,GOYARDゴヤール,ゴヤールバッグ,GUCCI グッチ,ショルダーバッグ,HERMES エルメス,エ Says:

    の、コピー。な,いたします。 、。ブランドバッグ {取扱ブランド|はルイヴィトン|、シャネル|、エルメス|、グッチ|、ブルガリ|、ロレックス|、オメガ|..ぜひ一度|ご覧 ください,コピーのお探しは5年間のスーパーコピー販売実績のコピーブランド激安通販店 へどうぞ!最高級スーパーコピーブランドを安心して買えるブランドコピー店ですよ,業界最大級のスーパーコピー通販専門店,財布などの度で造られています!財布,|全て最高 オメガ 、
    バッグ,CELINE セリーヌ,セリーヌ新作,CHANEL シャネル,COCOバッグ,キャンバストートバッグ,CHLOE クロエ,クロエ新作,GOYARDゴヤール,ゴヤールバッグ,GUCCI グッチ,ショルダーバッグ,HERMES エルメス,エルメス新作,バーキン,LOUIS VUITTON,エピ,ダミエ,モノグラム,モノグラムマルチ,ルイヴィトン新作,ヴェルニ,MIUMIU ミュウミュウ,ミュウミュウバッグ 時計,AUDEMARS PIGUET時計,オーデマピゲ偽物時計,Bell&Rossベル&ロス時計,ベル&ロス偽物時計,BVLGARIブルガリ時計,ブルガリ偽物時計,CARTIERカルティエ時計,その他,サントス,バロンブルー,ラドーニャ,ロードスター,CHANELシャネル時計,J12時計,CHOPARDショパール時計,ショパール偽物時計,CORUMコルム時計,コルム偽物時計,FRANCK MULLER時計,コンキスタドール,トノウカーベックス,マスタースクエアー,GaGa MILANOガガミラノ時計,ガガミラノ偽物時計,HUBLOTウブロ時計,スーパーコピー時計,IWC 時計,IWC偽物時計,JaegerLeCoultre時計,ジャガールクルト偽物時計,LOUIS VUITTON 時計,ルイヴィトン偽物時計,OMEGAオメガ時計,コンステレーション,シーマスター,PANERALパネライ時計,パネライ偽物時計,ROLEXロレックス時計,デイデイト,パーペチュアルデイト,TAGタグホイヤー時計,タグホイヤー偽物時計,TUDORチュードル時計,チュードル偽物時計,ZENITHゼニス時計,ゼニス偽物時計 最高級商品,【最高級】IWC時計,IWCスーパーコピー時計,【最高級】オメガ時計,オメガスーパーコピー時計,【最高級】パネライ時計,パネライスーパーコピー時計,【最高級】ブライトリング時計,ブライトリングスーパーコピー時計,【最高級】ブルガリ時計,ブルガリスーパーコピー時計,【最高級】ロレックス時計,ロレックススーパーコピー時計 財布&小物,CHANELシャネル財布,長財布,CHLOEクロエ財布,スーパーコピー財布,GOYARDゴヤール財布,スーパーコピー財布,GUCCIグッチ財布,短い財布,HERMESエルメス財布,ドゴンロング,ベアンスフレ,LOUIS VUITTON財布,キーケース,ダミエ,MIUMIUミュウミュウ財布,スーパーコピー財布,PRADAプラダ財布,スーパーコピー財布 http://www.agbhr.com

  13. zusätzliche Information Says:

    Zuerst hatte ich das Gefühl, jeder würde mir ansehen, was ich gerade getan habe, muschi galerie aber zum Glück schien es keiner zu bemerken.

  14. weiterhin das Lesen Says:

    Hunderte der geilsten Schlampen warten bereits auf Dich.

  15. against Says:

    skin care 85383 weather

  16. game Says:

    lifecell south beach skin care address

  17. force Says:

    garcinia cambogia hca extract best forskolin extract for weight loss best green coffee and garcinia cambogia together mac acai lipstick dupe mangosteen in south florida hoodia gordonii by vitality works herbs for diabetes simple fiber classification chitosan grassroots xanthan gum hair gel recipe lipozene diet pills for men glucomannan gummies implants

  18. under Says:

    best skin care with hyaluronic acid

  19. stop Says:

    skin care needling

  20. that guy Says:

    garcinia in cambodia forskolin journey youtube green coffee importers usa acacia hardwood flooring mangosteen pills what is hoodia gordonii side effects psyllium lectins chitosan là gì guar gum manufacturer in china lipozene maximum strength review glucomannan miracle noodle

  21. 【送料無料】new balance(ニューバランス) M1040 PERFORMANCE TRAINING(パフォーマンストレーニング) 26.0cm SKY BLUE/4E NBJ-M1040 S6 4E【SMTB Says:

    Do you have a spam problem on this site; I also am a blogger, and I was wanting to know your situation; we have created some nice methods and we are looking to swap methods with other folks, be sure to shoot me an e-mail if interested.

  22. 【アメリカLOVETHYBEAST】2012年にブルックリンで誕生した高級ペットセレクトブランド。ラブザイビースト フリップスティッチベッド オリーブ&イエロー Mサイズ【ベッド マット ハウ Says:

    I always emailed this web site post page to all my associates, as if like to read it after that my contacts will too.

  23. Gregory(グレゴリー)スカラー デラックス55300 Gregory(グレゴリー)より短期出張が多いビジネスマンにお勧めの大容量デラックスブリーフケースの登場♪2気室で書類とPC、または衣類などを用途 Says:

    When I originally commented I clicked the “Notify me when new comments are added” checkbox and now each time a comment is added I get three e-mails with the same comment. Is there any way you can remove people from that service? Thank you!

  24. ミエコウエサコ/ミエコウエサコ NOISY NOISY/ハイネックシャツ 長袖ハイネックシャツ フルーツフェイス柄 ストレッチ おちゃめな逸品【国内 送料無料】MIEKO UESAKO【レディース】ミエコウエサ Says:

    Thank you for the good writeup. It in fact was a amusement account it. Look advanced to more added agreeable from you! However, how can we communicate?

  25. Recommended Reading Says:

    research verified garcinia cambogia forskolin ultratrim green coffee storage acai que fruta es dr alfred mangosteen capsules hoodia gordonii for exercise w b12 shot psyllium zaden chitosan stacker 3 guar gum 4 u lipozene 35 pounds in 2 weeks glucomannan 2014

  26. 送料無料 バスケットワゴン5段 上棚付 5段 バスケットワゴン スリム 洗濯カゴ 洗濯かご æ´—æ Says:

    Hi there, yeah this post is really pleasant and I have learned lot of things from it regarding blogging. thanks.

  27. 【11/16(土)10時~エントリーでポイント10倍!】新品 箱・リボンでのラッピング CHANEL シャネ Says:

    A fascinating discussion is definitely worth comment. There’s no doubt that that you ought to publish more on this subject matter, it may not be a taboo subject but generally people do not talk about these subjects. To the next! All the best!!

  28. 【期間限定ポイント2倍】 日立 業務用エアコン 寒冷地向け 寒さ知らず ã¦ã‚“ã†ã‚ä¸­é Says:

    I do believe all of the concepts you have offered in your post. They are really convincing and will certainly work. Nonetheless, the posts are too short for newbies. May you please extend them a little from next time? Thank you for the post.

  29. Magic: the Gathering - Golgari Brownscale - Ravnica 【到着後レビューで素敵なプレゼント】トレーディング マジック ギャ Says:

    Nice post. I was checking constantly this blog and I am impressed! Extremely useful information specifically the last part :) I care for such information a lot. I was seeking this certain info for a very long time. Thank you and good luck.

  30. 卵油にんにく【3本セット】健康フーズ:(正規品)(サプリメント)黒岩式養鶏法によりつく゠Says:

    I read this article fully on the topic of the difference of most recent and previous technologies, it’s awesome article.

  31. <送料無料>【新品!/程度:N】 シャネル ブリリアントマトラッセ エナメル(パテントã Says:

    Great article.

  32. コーチ COACH 財布 ★送料無料12/27まで!★正規アウトレット★ ペイトンエンボスドパテントレ Says:

    Pretty nice post. I simply stumbled upon your blog and wanted to say that I have truly loved surfing around your weblog posts. In any case I’ll be subscribing to your rss feed and I’m hoping you write again very soon!

  33. 田中金属製作所グループのお店!【送料無料・ポイント10倍】【ワンちゃんの快適シャ Says:

    It’s remarkable for me to have a web site, which is useful for my knowledge. thanks admin

  34. 防水パンにおさまる。またげる。省スペースランドリーラック 段差対応タイプ・棚3段・ Says:

    Hi there, I think your blog might be having browser compatibility issues. Whenever I take a look at your website in Safari, it looks fine however, if opening in I.E., it has some overlapping issues. I simply wanted to provide you with a quick heads up! Apart from that, great blog!

  35. s3-website-us-west-1.amazonaws.com Says:

    Homemade salsa is easy to make, to make it organic, simply use organic ingredients.

  36. 2k16 mt pc sale Says:

    Today looks great .

  37. Leah Jackson Says:

    This iformation is priceless. How can I find out more?

  38. Zoe Carr Says:

    This is the great study for me, Have to acknowledge that you’ll be among the finest web owners When i at any time found. Appreciate it pertaining to submitting the next few paragraphs.

  39. my review here Says:

    haul my junk
    my review here http://www.aear-anor.com/sitemap229.php

  40. Learn More Says:

    15 yard dumpster rental
    Learn More https://www.etangdesmoines.com/sitemap402.php

Leave a Reply