You can never have too much of a good thing!

Running tests usually takes a lot of time and effort. There is planning, setup, executing the test, capturing data, and then processing that data. Having to rerun a test just to get some data that wasn’t captured before is a lot of work. That is why capturing everything up front can save a lot of time and aggravation.

A word of caution though. Watch the disk space while capturing. Make sure the drive won’t be filled with performance data. That could cause the test to fail and cause you to start all over again. Worse, parts of the system could become corrupted and require a complete reinstall and setup of the test.

So what do I monitor? Everything!

When using typeperf, nmon, JMX, database metric snapshots, or anything else; I try to capture much more than I need, but not so much so that I am capturing every piece of data possible. With typeperf, you can literally collect over 2000 different metrics. When pulling data from metric collection of a database, there can be hundreds of data points. Metrics about table spaces, buffer pools, resources, even down to the individual query.

Later I’ll discuss how I process this huge amount of data.

• Sun Java 6 Update 18 Released
  Sun has released an update to the Early Release Program with the following changes:

HotSpot version 16

Support for Ubuntu 8.04 LTS

JavaFX performance improvements

Java WebStart related improvements for Java Store requirements

List of deployment features:

Info

• Lessons learned from getting .NET to REST with Java Performance …
  By Andreas Grabner
  On a recent project I had to call Java REST services from a .NET Client. Several problems came up – ranging from authentication to hidden performance issues. I want to share my lessons learned and encourage you to share your own …

• New Java 6 Collections « Caught By Java
  By Asim
  Unlike Deque, List also allows us to insert or delete at any location within the list with a high performance cost. ArrayList has a higher cost for insert and delete operation as compared to ArrayDeque, as the portions of the array must …

• Stress tests rain on Amazon’s cloud
  CRN Australia – Australia
  The analysis simulated 2000 concurrent users connecting to services from each of … Net development platform, adapters are being released for Java and PHP …

Announcements

• Justice Dept says OK to Oracle’s $7.4 billion deal for Sun …
  By Jordan Robertson
  Clearance by the Justice Department had been held up over questions about the licensing of Java, a programming language that Sun invented that now runs on more than 7 billion electronic devices around the world, including cell phones … Sun’s performance had been shaky for nearly a decade before Oracle outbid IBM Corp. for the Santa Clara, Calif.-based company in April. IBM is one of Oracle’s biggest database software rivals, and is a major Sun rival in computer servers. …

• Measure Your System Boot Performance With Bootchart
  By Chinmoy
  Measure Your System Boot Performance With Bootchart … It aggregates the resource utilization and information of various processes using a script running in the boot up and creates an image through a java application after bootup. …
• 10 Really Useful Server Monitoring Tools
  By Tom
  With these server monitoring tools you need never worry ever again about the performance of your website as absolutely anything can be monitored from speed to security. … detailed reports and flexible alerts. This powerful tool, which supports Web 2.0, AJAX and plugin-based applications like Flash and Java, gives you a truly global perspective on how end-users see your site with monitoring agents stationed in the USA, Asia, Africa and Europe. webmetrics …
• Yet another bloody blog: What test technology and tools are you …
  By Mark Crowther
  It came as little surprise that the use of Selenium and Ruby was not what most expected as say QTP or Java are more commonplace. This prompted me to think about: What technologies and tools are you using now in the

Info

• A Few Speed Improvements – Blog – Stack Overflow
  By Jeff Atwood
  Anyway, we believe that performance is a feature, and we’re serious about the Stack Overflow family of sites being as fast as we can make them. We continue to revisit our performance every couple of months and try to improve it a little …
• Some Factors Driving UI Performance Analysis « Seven Seconds
  Ive decided to put some initial thoughts about factors that should be used by SPE’s for recommending a UI Performance Analysis project Ill briefly summarize …
• Java World: Performance Tuning in J2EE Applications
  By Pinaki
  Performance Tuning in J2EE Applications When it comes to enterprise scale Java applications there maybe severe performance degradations due to software architecture design flaws and application Infrastructure setup. …
• Carsonified » Five Things That Will Kill Your Site
  By Jonathan Howell
  This involves performance testing your application in advance. Set a level for what you consider to be an acceptable response time, and ramp up simulated users carrying out typical tasks until you exceed that threshold. … In theory modern garbage collected languages like Java and C# make memory leaks much less likely than the direct memory allocation of C and C++, but they are still possible: watch for memory allocated by static classes, caches that are not cleared, …
• Write high performance Java data access applications Part 3 Data …
  pureQuery is a high-performance Java data access platform focused on simplifying … Performance monitoring You can use hooks to measure API calls runtime …
• J2EE and Oracle Performance Musings: SQL Server Performance Snapshots
  By Chris Adkin
  When used with Catalog view and Performance Monitor counters, DMVs can provide the same functionality as Oracle10g’s Automatic Workload Repository (AWR). However, when working with SQL Server 2005, much of the intended purpose of …
• Java Memory Problems Performance, Scalability and Architecture …
  By Alois Reitbauer
  Memory problems in Java applications are manifold und easily lead to performance and scalability problems. Especially in J EE applications with a high number of parallel users memory management must be a central part of the application …

How To

• Java Tips: Optimizing your Map loop | satukubik
  By Nanda Firdausi
  From my tests, I observe that the performance of the first template depends on the backing object. If we are using HashMap, the performance is less or more the same as the second template. If we are using Hashtable, the performance of …

Java

• Java Standard Edition 6 Performance
  Java SE 6 Performance White Paper Javaâ„¢ Platform Performance Engineering Sun … and Performance Enhancements 2.1 Runtime Performance Improvements 2.11 …
• Java SE 6 Update 15
  Security and garbage collection update.
• Java SE 6 Update 16
  Security update.

]]> http://www.robertcasto.com/2009/08/08/week-in-review-8-august-2009/feed/ 0 http://www.robertcasto.com/2009/08/01/week-in-review-1-august-2009/ http://www.robertcasto.com/2009/08/01/week-in-review-1-august-2009/#comments Sat, 01 Aug 2009 18:20:10 +0000 robert.casto http://www.robertcasto.com/?p=157

Java SE tools for Performance Analysis and debugging GlassFish …
By admin
Java SE tools for Performance Analysis and debugging GlassFish. Teknoloji. 29 Jul 2009. For effective performance analysis, it is very important that you can collect data and collect them consistently. For you to collect quality data, …

Five Technical Details to understand before performing Load …
By Jaideep
For example it may be .Net or J2EE or any other. 2. Servers: What all server services you are using to run/ use this application? What standard server applications are used for Presentation, Application and Database level? Some ex… … 5. Access details: Last but not the least important point is how the users will be accessing the application – via LAN, through dial-up, through internet, through some specific port and third party tool etc. AddThis Social Bookmark Button …

• · Performance considerations while working with Strings and …
  By vogella
  Strings are very frequently used in Java programs. This blog post tries to explain what a programmer needs to consider from a performance point of view. It will also explain in what situations you should use StringBuilder instead of …

Tool

• · Groovy’s SQL Switch: A Powerful Tool In The Quest For A Truly Real …
  By Jason Kincaid
  … of the processing costs for the competing technologies below). The new software runs on special Intel boxes, with performance that the company says matches 100 standard SQL servers. For more, you can check out the full product spec sheet here. … Did they have to give it the same name as one of the main dynamic languages for Java? reply · Dan Grossman (@w3roi) – July 23rd, 2009 at 3:19 am PDT. Good to see they’re still going after almost having their code stolen. …

• · Borland Adapts Silk Test Suite For Agile Development
  InformationWeek – Manhasset,NY,USA
  By Charles Babcock Borland has adapted its Silk line of software testing tools to better accommodate modern development methods, particularly Agile-style …

• · java.net: Kirk Pepperdine Interviewed by Janice Heiss
  Janice Heiss interviews Java Champion Kirk Pepperdine about Java performance tuning and more in this java.net Community Corner 2009 podcast, recorded at JavaOne.
• · The Disco Blog » Blog Archive » To recurse or not: Euler challenge #2
  By Andy
  While I implemented problem #1 in Groovy, I thought it would be interesting to solve problem #2 in both Java and Groovy as I wanted to get a good feel for the performance differences between solving Fibonacci via recursion and iteration …
• Architect’s Blog
  By Guy Nirpaz
  New proxy implementation now supports faster fetch times, so that reading objects by their id from local cache is almost as fast as accessing a java.util.ConcurrentHashMap (in Java) or a Dictionary (in .NET). Raw performance of …
• PHP’s Scalability and Performance comparison over Java – Digg model
  By Jiltin
  In addition, many versions of PHP was used in the test, and substantial performance improvements have been made since and are continuing to be made. Here is the article from oreillynet: PHP scales! The word on the street is that “Java …
• Why is Performance Monitoring so hard? – brettdargan.com
  By admin
  Current State – Instantaneous State based; Alerting; Historical Stats; Trace (System > Component > Request) ~ Vertical Profiling through technologies; Profiling – usually technology focused, like Java Profiling; Vital Signs … Production – Under Load Times (batch or interactive); Production – Under Load and component Failures; Dev – Design/Architecture; Dev – Impl time; Test – Environment Issues – ala. Troubleshooting the Integration; Load Test Time; Soak Test Time …
• Amazon Web Services Developer Community Performance Monitoring for …
  Performance Monitoring for Autoscaling. Posted Aug 8 2008 943 AM PDT … As a Java developer I think of JMX which is baked into Java 5 and can be leveraged …

Book

• · AVIRADS-urs always: Java Performance Tuning 2nd edition – Jack Shirazi
  By avirads
  Method profiling can be done by java -Xrunhprof:cpu=samples,thread=y <classname> jhat included in JDK is Java Heap Analysis Tool. The JDK provides two methods for monitoring the amount of memory used by the runtime system. …

Product

• · GigaSpaces’ XAP 7 focuses on performance
  SDTimes.com – San Bruno,CA,USA
  XAP allows Java applications to be provisioned into distributed environments without requiring code changes or separate components for clustering, …

Information

• · Glassfish Terracotta Performance?
  By msnuser168
  Then I found the reason is when The threads in SOAP UI exceeed 256. Then some request will fail with “java.net.SocketException:Connection reset”. I am wondering how to configue SUN web server 7 to get better throughput. …. Subject: Re: Glassfish Terracotta Performance? [Up]. ari ophanim. Joined: 05/24/2006 14:23:21. Messages: 629. Location: San Francisco, CA Offline, Not sure I understand this at all. Sorry, but can you explain more about your test and environment? …

• · Java Logger Memory Leaks
  By Aviad
  Code, Performance Add comments. Recently we switched from Log4J to the java.util.logger package (for this entry it will be called the “Java Logger”). Why, you might wonder, and I don’t have a good reason to give other than the illusion …

• · OVERHEAD: Java Application Scalability « Welcome to the Real (IT …
  By Max J. Pucher
  HTTP requests are load-balanced across stateless servers and routed to designated J2EE server for processing. Such Java applications exhibit intratier communication complexity that directly impairs scalable performance. …

• · Java Buzz Forum Java Performance News June 2009
  We list all the latest Java performance related news and articlesIf the comparison is consistent things are due to start picking up again in the first half …

• · What should I look for when improving performance in Java Stack …
  The Java compilers are also pretty good at sniffing for performance improvements probably better than any single human So while there are some obvious …

• · javanet Kirk Pepperdine on Java Performance Tuning
  Kirk Pepperdine talks about Java performance tuning in this java.net Community Corner 2009 podcast, recorded at JavaOne.

• · Introduction to Java Concurrency « Pure Java Performance
  Presented by David Moskowitz to the Sarasota Java Users Group on June 11 2009 … In addition performance improvements are much easier to add to a logically …

• · Java Performance blog: Eclipse Memory Analyzer, 10 useful tips …
  By Markus Kohler
  Java Performance blog. This is my blog about Java performance related topics. Thursday, July 09, 2009. Eclipse Memory Analyzer, 10 useful tips/articles. The Eclipse Memory Analyzer has been shipped with Eclipse 3.5 Galileo and I planned …

• · Editor’s Daily Blog Community Corner Podcast Kirk Pepperdine on …
  In Java Today In Kirk Pepperdine on Java Performance Tuning Kirk Pepperdine talks about Java performance tuning in this

How To

• · Generating Dump Java Data Files
  Watching the Watchers.org – USA
  by panoskrt Recently I have been running some disk I/O benchmarks, among others, with Java. I needed to check I/O operations performance with plain data …

Blog

• · Giju George’s Blog: Performance Monitoring using JMeter
  By gijugeorge
  Apache JMeter is an open source tool that can be used to measure the performance of Java applications. The JMeter can be used to test a wide range of Java applications like web, EJB, web services etc. I am not going to elaborate more on …
  Giju George’s Blog – http://weblogs.java.net/blog/gijugeorge/

Book

• · SQL Server 2008 Query Performance Tuning Distilled | Porwin Ebook …
• By Admin
• Read query execution plans and identify bottlenecks in performance. * Record system performance metrics for trend analysis. * Learn to design databases and write Transact–SQL code to avoid common problems. …

The Internet is responsible for the creation of a great amount of wealth over the years. Granted, it is also responsible for the elimination of many businesses as well. This is how “creative destruction” works in our economy. New ideas and progress make people rich while old ideas die and go away.

If only this were true of the government though. Every year it just gets bigger and bigger. It looks for more ways to generate income to satisfy its insatiable appetite. In lean times, it resorts to stupid ideas like this one. It changes, many times for the worse, how the economic game of progress is played. Governments do well when the economy is doing well. They should do everything they can to help the companies within their borders to succeed. Instead, this looks like a destructive way to fill a budget gap. I fear that this is going to kill eCommerce as we know it.

Currently a great number of people make money sharing their expertise on the Internet. They get paid by promoting good products and warning us about bad ones. They inform us of ways to better our lives, and in return we purchase the products they recommend and they get paid by those selling the products. This is no different than sending a letter through the mail to a friend saying the new car they bought is incredible and that they should get one. Just because a company is willing to pay a finders fee doesn’t mean it has hired a person to do any work. It is rewarding the efforts of people to share information about products. This is advertising at its core and has been the basis of our economy for other 100 years. Companies pay millions to get the word out using advertising agencies. Does this mean that they now have a business interest in the state where the the ad agency resides? Most decidedly not.

Companies like Amazon agree to pay someone for help in selling a product. It is strictly advertising revenue, and they have no business interest in any state except where they have a physical presense. Saying otherwise means that every business has a business interest in every state. Any company wants to sell its products and doesn’t necessarily care whether what state the customer lives in.

If I recommend to a relative some service and I get a discount as a result, does that mean the company now has a business interest in my state? That kind of logic just boggles the mind. I was not hired by the company to do anything. I was encouraged to share information and for that they are most grateful when a sale occurs. To encourage this sharing of information, they offer an incentive. It is just that simple. Affiliate programs are just the same except that people have made a business out of it. If they are a business, then they must pay taxes where they live. That is how the system works and that still doesn’t mean that the seller of a product has a business interest there. Only that the person creating the link and posting information has a business interest. It is they who should be paying income taxes on the money they collect. But they didn’t sell a product. They didn’t handle any money. They didn’t do any activity that would connect them with the seller other than mentioning where a product may be bought.

For decades traditional companies have sold items across state lines. The products were shipped to other states and no sales tax was collected. There was no legal right to it because the purchase was from a company in another state and so no tax was collected. Internet companies operate the same way except that with the Internet, it is now easier to find their products and make a purchase. Lots of technologies have converged to help make this simplicity a reality. Now the states are rushing in and crying foul. They want to collect taxes on sales to which they are not entitled.

Companies are not stupid and the best will survive. If they find it cheaper to shut down an affiliate program than to continue one, then standard business practice demands that it be shut down. The states have essentially pushed a logical decision in response to their illogical argument. It should be no surprise that the small business will suffer as a result.

I find it despicable that a state would even consider pursuing such a course. They stand to loose a great deal. Many small companies will shut their doors since their income has been cut off. Millions in taxes collected from these business and their workers will disappear. In its place will be people filing for unemployment benefits along with all the other welfare handouts the government has to offer. States should spend their time trying to figure out how to get people back to work. They should try to educate workers, helping them train for the jobs in demand today. Instead, they seem determined to look for the quick path to cash as a means to solve their problems. This is destined to end in failure bodes ill for the country. Millions of jobs have already been lost. Let’s stop looking for ways to eliminate even more jobs.