An independent experts group has created a ERP software evaluation tool: www.evaluation-matrix.com

After accumulating feedback about current ERP top solutions from more than 4080 experts on more than 900 criteria openERP comes out as clear winner, beating Dynamics NAV, SAP, Sage and even openBravo in nearly all important categories - features, ergonomy, TCO, technical excellence.

The only "weak" area for openERP is market position, which does not bother me.

Actual scores are:
OpenERP 72%
OpenBravo 41%
Dynamics NAV 55%
Sage 34%
SAP R/3 65%
Dynamics NAV2009 61%

(100% means all experts agreed that all criteria is fully met.. Lower score means less experts and less criteria)
Given that evaluation is run by independent consultants and thousands of experts you can be sure of openERP!


Disclaimer.
You do not want to search whois to find owner of the domain.
You do not want to add your vote or you will find that your freshly added opinion represents 30-50% of industry knowledge, depending on criteria.

As our Ethics teacher put it: ethical is what society approves. Should I just shut up and instead help the cause?

well the evaluation-matrix is actually a great idea. I only wish that some other ERPs are added to it including Adempiere, WebERP as well as Oracle and the SAAS / SME solutions from SAP.

A great feature would be creating a more granular comparison of all "core" features as well as having sub-sections where the vertical-solutions and add-ons are also included... of course such a comparison site would be extremely large and complex, comparisons with the scalability and different scenarios (i.e. different licencing terms for the closed-source) would add another important dimension to it.

Of course the fact that its run by Openerp is not a problem per-se ... it would be better to declare that "bias" though on the site.

something like CMS matrix (but taking into account the inherent complexity of ERPs) would be GREAT (it also helps all the ERP players know what weaknesses they have to plug, and give SMEs information to lead them to more suitable solutions).

This website is hosted by Tiny but we subcontracted ERP experts from competitors to fill in the matrix. We focus on a pragmatic approach based on reliable and quantifiable criteria only.

For example, this is a good criterion "you have to press less than 10 keys to encode an invoice" and we avoided criteria like "the encoding of invoice is very fast". The first one is quantifiable and verifiable.

It's also community based, everyone can propose new features or change some factors. All votes have exactly the same weight. IIt allows everyone to check and/or critics the data. We already have more than 4000 feedbacks, by 200 people. For example, we received the list of all new features in the latest version of Openbravo and they have been integrated in the system.

Check this page for more information: http://evaluation-matrix.com/about/

So, yes, the tool is provided by Tiny. Someone had to do it and we did it. This is the only complete and systematic ERP comparison study available for free.But we setup everything in such a way that it is not subjective, nor Tiny dependant.

Just for info, it also costed us a lot of money to find consultants to fill in the criteria for the different softwares. We are also looking for experts having a strong knowledge in others softwares. If you think you can contribute, please contact us.

Fabien your answer should be on the about page IMHO.
Hiding Tiny makes visitors suspicious.
After all you did play fair, so you could even brag about it !
Lionel.

@Fabien

Quote:

This website is hosted by Tiny but we subcontracted ERP experts from competitors to fill in the matrix. We focus on a pragmatic approach based on reliable and quantifiable criteria only.

Probably Tiny should be mentioned a bit more visible in order to avoid this kind of critics.

Quote:

So, yes, the tool is provided by Tiny. Someone had to do it and we did it. This is the only complete and systematic ERP comparison study available for free. But we setup everything in such a way that it is not subjective, nor Tiny dependant.

Agree that public availability of this study is very good.

Quote:

Just for info, it also costed us a lot of money to find consultants to fill in the criteria for the different softwares. We are also looking for experts having a strong knowledge in others softwares. If you think you can contribute, please contact us.

No doubt that it costs a lot of money.

Summarizing all of this, renders that this is respective source:
1) if one who presents it, do not mention who runs and owns this resource;
2) not mentions that no other ERP software package refers to it (do not care what is the reason);
3) do not care that this is not done by external respectable independent test laboratory.

Kaspars
----------------------------------
http://kndati.lv

@fabien

Thank you very much for explanation. Evaluation is good initiative and I can understand your willingness to "stay out". But if you put second thought of it, may be you find that being open about your role and status is better than present it as "neutral".

Direct question to Fabien:
- will you disclose Tiny relation in About (or everywhere in the site)? (your explanation here is very reasonable to replace that "neutral profesionals" message).
- will you change "4000 user's feedback" to "4000 answers from users"?

My further wishlist would go:
- openERP centric. (I would not come to eval site to see R/3 and Axapta compare on load-balancing cluster features)
- DESCRIPTIONS. In many cases you can't quantify experience. Things like built in IDE, version control can be love or hate features. Argumented evaluation is more valuable to decide yourself.
- Author. Anonymous feedback is good. Authored feedback is credible.
From what I found the best expert on openERP is Rafael Valyi. He is postive, knowledgable, sharing and honest. I trust his opinion over any number of voters.


p.s. is it openObject platform behind it? The submission form looks very much openERP-ish.

@vrs,

Quote:

from what I found the best expert on openERP is Rafael Valyi

Hey thanks. I'm actually a "visible" expert of OpenERP but I sure in a great range of features (like accounting) there are lots of independent guys here that know it much better. My "added value" has been in digging deep into the other open source alternatives thanks to the Smile whitepaper initiative. Still, lots of folks here also know proprietaries ERP's so much better than me.

Quote:

p.s. is it openObject platform behind it? The submission form looks very much openERP-ish.

Yes absolutely, it's the "comparison" module inside the trunk-extra-addons branch on Launchpad here:
https://code.launchpad.net/...addons/trunk-extra-addons


BTW, Fabien, I agree with what has been told here, it's difficult to trust someone who is somewhat both judge and party, no matter how honest is your comparison (even if I agree on the centric stuff and bug levels also plays a huge part in implementation cost, it's not reflected). An immense part of OpenERP competitiveness is also its ease of extension by coding simple modules, that study doesn't reflect it either, that's a bad point for OpenERP.

Finally, my take is that you better allocate those resources on your product, it will soon be so great that no one would question it instead.

I even think that Smile's withepaper I wrote will be dead in 6 months or so, for the same reason that Smile and me are now judge and party (we weren't), the product evolves and neither Smile neither me can claim to extend the study further impartially unfortunately (but others could do it).

An other reason why this withepaper will be dead is that I really bet OpenERP will be so much stronger than the OSS alternatives in say one year (Not only you are years ahead already, but you also develop times faster using a fraction of the resources other like Compiere or Openbravo spend). Who will really care comparing OpenERP to say ERP5 then? Chance are this would be like comparing the Linux Kernel to GNU Hurd, not even pertinent anymore.

However, I'll myself rather spend time showcasting OpenERP, I believe this will just be way more efficient in promoting it, cause there aren't so many products embracing such a large scope you can download for free and start ensuring what is showcased actually works (well, when there is no bug . Most of your open source rivals are doomed to slideware demos instead, ashamed by their own obsolete interfaces and lack of business features, with no community contributing awesome stuff to show every month.
_________________
Raphaël Valyi

CEO and OpenERP consultant at
http://www.akretion.com

I find the site interesting and I am an enthusiastic contributor to OpenERP but the results do not make sense to me. Maybe a performance criteria is missing (transactions/minute, entries per day, stability, concurrent users, etc.). I do not know the reason but the low score for SAP, putting it at the same level of Dynamics just don’t make sense.

I would like to use the site to promote OpenERP to new prospects, but the way it is now, it is not convincing, what could I tell a client? Please review the criteria to make it more reliable and truthful.

please does anyone kknow how to backup our dear database, because this seems to me like a little problem.

I know opeerp has not yet started making waves in the market but we all have to come together to report and help fix the bugs as they come up ,
and i bet us that sooner than latter it will be a household ERP system
_________________
get modulated

hello

I have found the Evaluation matrix as best tool available in the market. since the site is launched I have been keep on visiting the site regularly. I have found that the work done by Evaluation matrix team is 98% correct.

I am thankful to the fabien who initiate such project which is really helpful. There is no other site or comparison tool available on market.

I really don't find the its bias or for marketing of Open ERP. Evaluation matrix is allowed to people add more criteria and votes, you all can suggest to them.

@pedro_maschio,

I think you should see the status of SAP R/3(eval is not finished yet). SAP R/3 is very big system it will take time to get complete evaluation.

Regarding criteria, yes they also have to add more criteria, there are few things are missing in criteria list.

I really appreciated the work. Keep going. Please add more ERP systems.

Thank you

The statistics is simply not true. You can read this from Market Position with Openbravo ERP.

^o^

[quote="fabien"]This website is hosted by Tiny but we subcontracted ERP experts from competitors to fill in the matrix. We focus on a pragmatic approach based on reliable and quantifiable criteria only.

For example, this is a good criterion "you have to press less than 10 keys to encode an invoice" and we avoided criteria like "the encoding of invoice is very fast". The first one is quantifiable and verifiable.

It's also community based, everyone can propose new features or change some factors. All votes have exactly the same weight. IIt allows everyone to check and/or critics the data. We already have more than 4000 feedbacks, by 200 people. For example, we received the list of all new features in the latest version of Openbravo and they have been integrated in the system.

Check this page for more information: http://evaluation-matrix.com/about/

So, yes, the tool is provided by Tiny. Someone had to do it and we did it. This is the only complete and systematic ERP comparison study available for free.But we setup everything in such a way that it is not subjective, nor Tiny dependant.

Just for info, it also costed us a lot of money to find consultants to fill in the criteria for the different softwares. We are also looking for experts having a strong knowledge in others softwares. If you think you can contribute, please contact us.[/quote]