Morale at the workplace

It never ceases to amaze me how "official" our upper-admins try to be. First, we caught the wave a hiring and listening to consultants (Gartner Group comes to mind); I have never seen any benefit attributed to those exercises, except several departmental reorganizations, music chairs and the top folks getting richer. Thankfully, some small bit of sanity has returned in the last year or two, but there is still a mentality of "running a good business" that does not translate well when trickled down through the ranks. The latest "trend" is getting certified in ethics, sexual harassment awareness and security protocols. The same thing, year after year, and at a time when our elected state officials are the worse role models in the world.

But I digress...

Morale. Like a perfectionistic parent, it often seems that the message to use in the trenches leans towards "don't do this" or "do this". There is little positive reenforcement for jobs well down, and even less obvious efforts to draw the organization together; skimpy efforts at community building events, lackluster performance evaluation system that leads to general confusion about raises, and even greater confusion about priorities. Too much negative emphasis, too much micromanagement.

The people that stand out are those who lean towards workaholism, whether it be because they feel compelled to work harder or some other reason. The average joe is essentially ignored, and the "operating procedures" from on high can be seen as oppressive measures.

I love my job. I love figuring out problems, exploring new features of the RDBMS, and working with others on a project. Unfortunately, those projects seem all to often like black holes to me - hopefully, surely, somebody has a clear idea why we are investing our time in various projects. Not just "because someone wants it", but how is it progressing along our company's goals.

I love the people I work with; a diverse group in terms of culture, talent, personality and ambition. All sorts of strange conversations come up. =) But better yet, it helps to develop me as a person and DBA.

I guess it would be nice if things were more fun. We work hard, and often the rules we have to follow feel like punishment. I wonder if this is to keep the rebellious few in line, or because some talking head suggested that it was better this way. Whatever it is, it certainly makes me glad I am not running the show.

Wow

What else can I say. =) It would be a miracle if I passed. Wow. In my defense, our test started about 5 hours later than the stated, published time. And for those who have been through that grueling experience, you know that such a time schedule would amplify the difficulty. If I do pass, I will have enormous bragging rights! But, believe you me, I did not pass.

Getting ready for the plunge

This will be my last post before I sit for the OCM. I have mixed feelings about it - the 9i OEM tools are littered with bugs and holes, and while the tool (if you can call it that) may be good for some specific scenarios, I have come to detest it. Especially the java interface, which is cheapened even more on the RedHat platform (some buttons are truncated or all-together missing). On the good side, I have gotten to know RMAN a whole lot better. Reading Robert Freeman's book (and running into him on oracle-l) has been good, and Oracle has improved RMAN so much since 8i that I am actually impressed. It took them a while, but they finally come out with something that is more helpful than painful.

Another thing that concerns me is that I am not a good test-taker. It helps tremendously that this particular Practicum will be scenario based - it will almost be like "normal work". Except no socializing, no music, no Google, and the snacks are .... well, it will sustain me at least. So, not quite like work, but the actual "doing it" will be.

I also look forward to networking. There will be 6 others taking the Practicum with me, and it will be interesting to hear about their backgrounds. And assuming I pass, I am excited about meeting the community of Masters out there. If I do not pass, I will just have to wait a bit longer. *grin*

Based on the public information available about the Practicum, and anticipating a NDA/gag-order, here is what I believe the test will be like (all of this is from memory):

• Primary focus on "normal" activities
• install software (not sure how much of this we will have to do, since it takes time)
• setup environment
• setup OEM
• setup RMAN
• setup/configure database (different flavors, different purposes)
• setup network files
• backup/recovery
• "recover from any failure scenario" is rather intimidating
• Time is an important resource, so a cold backup every hour is not going to work
• tune performance
• manage database
• add/drop tablespaces, tables, objects
• adjust storage specs as needed
• Secondary focus on specific features
• shared/dedicated servers
• standby database
• partitioned tables
• data access
• security, including vpd/fgac
• auditing
• Tertiary focus on more advanced things that do not really work well (the GUI sucks!)
• Advanced Replication
• Resource Management
• Possibly Dataguard

It is my theory that if you can do the Primary things perfectly, the Secondary things fairly, than the last group is completely optional. I could be wrong, but this is what my intuition tells me. I guess we will see how good that semi-conscious knowledge is. It sounds like backup/recovery might be a big issue. I have been practicing on a really small database, which means that a full backup and restore does not take that long. In the real world, we do incremental backups, but a recovery from an incremental may still have to restore the full backups. Logical corruption will be a bit more interesting - I plan to use db_block_checking and rman's "check logical" to help in that regards, but there still may be things like dropped data (flashback!) or dropped tables and there may be a requirement to recover just that object. On a larger database, that will be interesting. I am thinking that the storage is moderate; it will be a medium sized database (perhaps 20-50 gb), with enough room for a couple full backups, but not much more. If the database is smaller, that would be awesome - smaller means faster backups and easier to manipulate. Perhaps the database will start small but grow as the days goes on.

There is a blurb in the Oracle documentation about the Practicum that says one should use so-called "best practices" and Oracle tools to speed things up, because you are on the clock. I feel pretty confident that I can do most things reasonably fast, but I do have doubts in the back of my head. I can setup a standby database using rman (and using the same technology, create a clone for replication or whatever else). I can use OEM for most of the basic tasks, but I worry about how fast that will actually be, as opposed to just using the command-line which I am more comfortable with. For instance, one of the bullet points for the exam prep is "Use OEM to modify a database configuration". You mean like "alter database set optimizer_index_caching = 80"? Do you realize how many button clicks that is? 8, with a wall clock time of 83 seconds (which obviously depends on how fast your computer is).

In closing, I also wonder how different the 10g OCM is. Could I take that now? I have been working with 10g for a little while now, and know my way around EM/Grid Control. In some respects, it is much better. One of the downsides is that the new EM is so comprehensive that one can easily get lost if you are in unfamiliar territory. See my previous posts about trying to manipulate the Maintenance Window. *grin* I am not going to switch my course of action now - sticking with 9i. But I do wonder... perhaps I can get a steep discount and take the 10g OCM in the near future.

And finally, I remind myself that there are many many smart people out there who have not even taken the OCM just because they do not see a good reason for it. If/when I am a fully certified Master, I still realize my low post on the totem pole. The folks on oracle-l, askTom, the oracle forums (and even the dwellers in metalink Forums) and a slew of other places, are extremely smart and I learn from them on a daily basis. I hope to be able to contribute something, but just because of some pretentious title does not mean that I know everything.

Buggy bugs

This past Sunday (05-NOV-2006) we installed patch 4752541 (Intermittent PLS-306 / ORA-1722 / ORA-1858 under load) to fix a problem our webapp was having on overloaded procedure calls. We were looking golden up until Wednesday when our Production system starting spiking on library cache latch waits (and log file sync waits were in there as well). Being good little Oracle DBAs, we filed a case with Oracle Support, and learned a bit, but nothing really concrete. That evening we hit another major slowdown. It was decided to yank out the Sunday patch because it did exhibit some relationship and we thought it best to be safe. So here we are, Friday, with no more critical slow downs but still hitting the original webapp errors. We now have 3 SRs open with Oracle, 4 engineers working on them, two "team leads"/duty managers keeping tabs, and a cell-phone number for the Director of Oracle Support.

All this to say that Oracle is really, very complex. We still do not even know for sure if the patch caused the slowdown, all we have is the circumstantial evidence. This also showcases why you get a 10gR2 patchset that is rife with bug fixes and has a footprint that is as large as a baseline install. 10.2.0.3 promises to be more of the same, meaning that 10.2.0.2 had little to no impact on the number of bugs. Granted, 10.2.0.2 did fix a large number of problems, but it looks like the sum of the ones that got through the cracks and newly introduced bugs (ala "Buggy bugs") totals the bugs fixed.

Just to set the record straight, I only complain and gripe about software I love.

Oracle has not yet learned the definition of "unbreakable"

Given:

oracle.com on October 30, 2006



Given:

unbreakable

un·break·a·ble (n-brk-bl) Pronunciation Key Audio pronunciation of "unbreakable" [P]
adj.

1. Impossible to break; able to withstand rough usage: unbreakable plates.
2. Able to withstand an attempt to break. Used of a horse.


Given:

Metalink SR tool on Monday, October 30, 2006

Oracle announces Enterprise Support for Linux, for half the price

This is sad. This exemplifies the statement "You get what you pay for."

Much has been said, and much is still being said, about this poor decision, but my favorite so far is Dave Dargo's Bull*%$#!

Support Analyst caught asking Tom

I found this very interesting.
http://asktom.oracle.com/pls/ask/f?p=4950:8:::::F4950_P8_DISPLAYID:707586567563
Search for "We have noticed several system tables where"

Keeping that in mind, here is my question in SR# 5684375.992 on 11-AUG-06:

This SR is for information only. We have noticed several system tables where dba_tab_col_statistics reports HEIGHT BALANCED histograms where bucket_cnt > distcnt (count of distinct values). It was my understanding that a similar problem was fixed in 10.2.0.1 (dbms_stats method_opt size n generates a FREQUENCY histogram where n >= NDV). However, even more perplexing is why do we have many height balanced histogram buckets on a column with only 1 distinct value?

SQL > select ENDPOINT_NUMBER,ENDPOINT_VALUE 
from dba_histograms 
where table_name = 'INDPART$' 
and column_name = 'TS#';

ENDPOINT_NUMBER ENDPOINT_VALUE
--------------- --------------
            217             79

So, some questions?
1. in sys.hist_head$, how is bucket_cnt calculated?
2. what determines how many buckets a column gets?

Is it just me, or did my support analyst ask my question on AskTom, verbatim?

While I like Tom's cavalier attitude in general (ala "and you don't need/want to be querying hist_head$, just use the normal views like the rest of us :)"), I sure wish he answered the question.

Another interesting point: this question was posed on August 14th, the same day I got fed up with the Support Analyst and asked to switch to someone else. I liked the 2nd guy much better! You could give him awards. But that first guy… wow, he needs help.

As I said, just very interesting. I wonder how many other Support Analysts I can find on AskTom.