@Vol
You can get basic checks on an electrician using the Registered Competent Scheme - Electrical here:-
Home - http://www.electricalcompetentperson.co.uk/
This will tell you if the person you are about to employ is a member of one of the competent persons schemes. As you've pointed it, whether these schemes adequately serve their purpose is open to debate, but it is a good start as they do require you to prove you have certain qualifications, certain insurances etc. in place. I have photographic ID provided by my scheme and if you were my customer I would happily provide you with the details you need to go off and confirm what I'm telling you.
However, in the case of electricians, you don't need to be a member of these schemes to meet your legal obligations under the building regulations and this is where it starts to get a bit tricky. I can't say for Scotland, but in England and Wales if I want to change a consumer unit I either be part of a scheme and notify the work myself via my scheme or I pay LABC and submit an application to carry out the work and they will inspect it.
So the reality is, you could notify building control, pay their fees, change the consumer unit yourself and they'll arrange for it to be inspected/tested to ensure compliance with BS7671 and the building regulations (how good a job they do is probably another subject which is open for debate). The unfortunate thing is there is nothing stopping an unscrupulous cowboy not telling you what his obligations are, and all too often this works because home owners are, in my experience, woefully uneducated when it comes to the requirements of building regulation and electrical certification.
In terms of finding this fault, there are various stages of testing that should be carried out as has been stated previously. There are the dead tests which serve to prove the continuity of the circuits and that their polarity is correct. They also aim to check that the cabling is in good condition and that no faults exist on the fixed installation that could trip the RCDs. If this isn't done, how can you know whether it's the fixed installation that is at fault or a piece of equipment connected to it?
The fact that there was surprise when the RCDs didn't trip suggests that some (or all) of these tests were not carried out. This suggests a lack of something in the person carrying out the work. Knowledge, equipment, morals, it's difficult to say.
In terms of the reversed polarity, this should have been identified and corrected BEFORE the main switch was turned on. A socket tester is the last piece of test equipment I use and serves as a verification only that power is on and there are no obvious faults at the socket outlet to which it is connected. An approved voltage indicator is the tool for detecting polarity issues at the supply and as I say, this should have been done before that main switch was flicked to ON.
We disagree on things (including how you should proceed) because we all have different views and experiences and as has already been highlighted the wiring regulations create grey areas which are open to interpretation. However we are all agreed that this is a dangerous situation that should have been resolved already and that you should minimise your use of the installation.
We are not immune from making mistakes and I don't believe anyone has suggested we are infallible, we are after all only human, but testing procedures are down in black and white and are there for a reason... the safety of our customers and the installations we work on. Not following them is an act of gross negligence that can result in the kind of situation and danger you are now subjected to.
These things will make us question the competence and ethical standards of the person carrying out the work because for us, it is incomprehensible that someone would leave a customer site knowing the risks this fault presents and this unfortunately is human nature because we invariably judge others by the standards we set ourselves.
But, they will also make us question the the validity of the information provided and whether in fact a spark was involved at all, because quite simply I think deep down we would all like to believe that someone who calls themselves an electrician could not be guilty of such gross negligence and have such a cavalier attitude to electrical safety that they just up and leave for another appointment knowing this fault existed. It's so fundamentally wrong that we have trouble wrapping our heads around the fact someone could do it (I'm not ashamed to admit I have also wondered whether we've had the truth, the whole truth and nothing but the truth), and I'd go so far as to say that if I got called in to clean up after such an event I'd be wanting full details of the original spark so I could report them to their scheme or trading standards. That's how bad this is and as I say, I think we just have trouble accepting the fact that someone trading as an electrician could do it because it goes against the grain so fundamentally we struggle to accept the facts.
With regards to missing an opportunity for the consumer unit to protect against reverse polarity, we are there to protect against reverse polarity. The checks we are supposed to carry out are there for this exact reason.
Please come back and let us know the outcome of tomorrow.