The last couple of months I have been assigned to a project dedicated to deployment automation including several levels and types of technologies: database, middleware, services and portals. The selected deployment tool is XL Deploy from XebiaLabs.
One of the main challenges was to determine the proper order of the steps within the deployment plan considering the dependencies between the several artifacts.
1 Basic features for orchestration
Deployment with XL Deploy is a joined activity (more...)
event histogram metric, a script and some related comments on collecting and displaying wait event latency histograms for Oracle performance troubleshooting.Why:
Latency histograms (and by extension wait event histograms) provide very useful information when troubleshooting performanc
e for systems exhibiting response time with multi-mode distribution. In such cases average wait values are often not sufficient to understand the behavior of the system under study and histograms
provide a finer level of details. A (more...)
We have been running an experiment for the past few months: if we host a weekly online webinar, will anyone show up?
We – the Database Developer Tools team, mostly – want to try different things, find different ways to reach new developers and make Oracle Database as approachable as possible.
For example, this week Product Manager Melli Annamalai – she is a BIG DATA expert, so don’t miss this one!!! – will be doing (more...)
In most cases edb360 takes less than 1hr to execute. But I often hear of cases where it takes a lot longer than that. In a corner case it was taking several days and it had to be killed.
So the question is WHY edb360 takes that long?
Well, edb360 executes thousands of SQL statements sequentially (intentionally). Many of these queries read data from AWR and in particular from ASH. So, lets say your ASH (more...)
Topic: PyLatencyMap v1.2
and how it can be used to produce heat map visualization of SystemTap histograms.Introduction:
When studying storage performance, the latency drill down is a very important data source. Measuring the average I/O latency is often not enough, latency histograms are proven to more suitable for investigating modern storage systems. This is because for many storage systems the response time has multiple modes: think for example of the common case of storage (more...)
During my 17 years at Oracle, I developed several tools and scripts. The largest and more widely used is SQLTXPLAIN. It is available through My Oracle Support (MOS) under document_id 215187.1.
SQLTXPLAIN, also know as SQLT, is a tool for SQL diagnostics, including Performance and Wrong Results. I am the original developer and author, but since very early stages of its development, this tool encapsulates the expertise of many bright engineers, DBAs, developers and (more...)
Contentcuratie met expertlijsten
Met ruim 9 miljoen producten in de winkel valt er natuurlijk van alles te ontdekken in een winkel als bol.com. Om je te inspireren en wegwijs te maken in dit enorme aantal, worden er steeds meer experts en productkenners uitgenodigd om expertlijsten te maken.
Naast productspecialisten in dienst van bol.com krijgen verkopers, leveranciers en affiliate partners de mogelijkheid om selecties te maken en zo bezoekers van bol.com te inspireren (more...)
Working with database performance troubleshooting means dealing with challenging and exciting problems. But it also means doing certain things over and over. And over. Like typing the same query or clicking the same button zillion times a day. And when you’re doing something very frequently, anything that can be done to simplify or automate such tasks becomes very important. So I decided to share some of the tricks I use to optimize my working experience in (more...)
Occasionally one might want to know what a segment is made of in terms of block types. For example, you notice that the number of blocks in an index segment is somewhat larger than the number of branch and leaf blocks, and wonder what kind of blocks accounts for the difference. The only way to do this is by dumping index blocks (e.g. as described in Richard Foote’s blog here). Dumping blocks is easy, but (more...)
Meetup maart – Docker en Elasticsearch
Voor maart hebben we twee interessante bijeenkomsten gepland bij bol.com.
Docker Meetup – Deep dive into Docker storage drivers
Op 5 maart hosten we voor de tweede keer een Docker Meetup in Utrecht. De presentaties worden verzorgd door:
- Jérôme Petazzoni (Senior Engineer Docker)
- Kay Davenport (Developer Evangelist ClusterHQ)
Inschrijven kan hier.
GOTO Night: Elasticsearch
Op 25 maart hosten we voor een GOTO night over Elasticsearch. Sprekers zijn:
This post is about the latest updates to PerfSheet4
v3.7 (February 2015). PerfSheet4 is a tool aimed at DBAs and Oracle performance analysts. It provides a simplified interface to extract and visualize AWR
time series data using Excel pivot charts.
PerfSheet4 is aimed at querying and displaying time-series data from AWR repository tables. This is very a rich source of information to analyze database workloads and trends in the context of performance analysis or (more...)
Sometimes development is just work
No matter how cool your job is, no matter how many people are looking at you or your company for best practises, sometimes developing software is just work On this blog I’ve shared examples of companies that people nowadays see as successful, like Netflix, Twitter, Spotify, or the online retailer bol.com.
To prove my point I’ve checked the release notes of Netflix and Spotify apps. Here (more...)
Book – The Phoenix Project
The Phoenix Project: A Novel About IT, DevOps, and Helping Your Business Win is written the by Gene Kim in the tradition of The Goal (1984, by Dr. Eliyahu M. Goldratt). The Goal is a management novel explaining the Theory of Constraints. This book, The Phoenix Project shows how the theory in The Goal works in an IT environment.
The Goal – Theory of Constraints
In simple terms the Theory (more...)
This post is about tracing logical and physical reads in Oracle using systemtap. You will find a few examples illustrating the main mechanisms used by Oracle to do physical and logical I/O and you will learn how to build systemtap scripts to further explore and troubleshoot Oracle I/O.Introduction:
Performing input/output to and from the storage media, i.e. physical I/O, is one of the critical tasks underlying all database engines. When accessing data (more...)
Spotify engineering culture part I & II
I’ve been reading quite some article on engineering culture and ways of working. The videos on Spotify Labs are among the best sources I’ve watched or read in the last year on the subjects of agile and culture. Recently the second part of their series on Spotify’s engineering culture was released.
Spotify engineering culture part I
Important take aways for me were:
- Agile over scrum
- Principles over practices
This post is about using SystemTap
for investigating and troubleshooting Oracle RDBMS. In particular you will learn how to probe Oracle
processes and their userspace
functions. These techniques aim to be useful
as well as fun
to learn for those keen into peeking under the hood
of the technology and improve
their effectiveness in troubleshooting and performance
is a very powerful technique that can be used to complement the available (more...)
Book – Hatching Twitter: A True Story of
Just finished reading Hatching Twitter: A True Story of Money, Power, Friendship, and Betrayal and I must say that I wasn’t as impressed as when reading for example The Everything Store. The book is more about politics and opportunities than about creating opportunities and value or generating great ideas that others can build on. Of course this can still offer a great story and be a good (more...)
This post is a hands-on introduction to using on-CPU Flame Graphs for investigating Oracle workloads. This technique is about collecting and analyzing sampled stack trace data to analyze and troubleshoot Oracle processes at the OS level (in particular applied to Linux).Motivations:
The techniques and tools described here can be used for performance investigations
to complement wait-event based information gathered from the Oracle engine, such as information available with ASH and sql monitoring. They (more...)
My carpenter has been putting in a new floor in a room in my house, and I noticed that he makes some of his tools as he goes along.
It’s not that he doesn’t have a hammer and a cordless electric screwdriver. But every once in a while, he needs to move, align or support something in a way that his standard tools do not support. So he immediately builds an ad-hoc tool out of (more...)
This post introduces the latest changes to OraLatencyMap and PyLatencyMap, two custom tools for collecting and displaying Oracle wait event latency details using heatmaps.OraLatencyMap
is a SQL*Plus tool, with a core written in PL/SQL, aimed at studying Oracle random I/O by displaying the latency drill-down of the wait event 'db file sequential read' using heatmaps. The tool can also be used to collect and display event latency histograms for any other Oracle wait (more...)