Optimizely Web Experimentation Reviews

“Thrilled to see data supports our ideas

Pros

Just getting started at Century Communities but so far this has helped marketing feel comfortable moving away from assumptions and rely more on data, while also pushing this message to our C-Suite.

Cons

I think its too early for me to give a full answer. The training seems long and a bit overwhelming.

“Great tool with web experimentation

Pros

Their onboarding consultant made setting up the product really easy for us.

Cons

We find it challenging to build a backlog of tests to implement quickly.

“A powerful tool!

Pros

Web Experimentation, unsurprisingly is built for experimental practices common in many organizations. But it's also a powerful tool for quickly delivering complex content updates without formal deployments. For me that is the most exciting part. It offers an immediate way to make small, targeted website changes without the usual planning, development, testing and deployment cycle. When used carefully and with a clear understanding of scope, it is a smart, agile extension to our delivery toolkit. It helps teams respond fast to business needs, test ideas with little friction and optimize user experiences in real time.

Cons

Web Experimentation is quite fast and flexible but if you don't use it carefully, let me tell you that it can cause real problems. The thing that makes it so powerful being able to skip the normal delivery steps, also makes it really easy to misuse. Since changes can go live so quickly, there is a big temptation to skip important steps like peer reviews, testing, accessibility checks and getting everyone on the same page. This can create a sort of "shadow" process where decisions happen in isolation without enough visibility or accountability over time. Basically it is easy to mess things up. Without solid governance or a team that really knows when and how to use it right, Web Experimentation can lead to technical debt, inconsistent user experiences or bugs that are hard to track down. If used carelessly it ends up being a shortcut for bad practices instead of a smart way to stay agile.

“Good AB testing tool but requires advanced technical skills

Pros

It is a technically advanced tool that can handle complex tests but requires good development skills.

Cons

There are a few things that I have noticed such as metrics management is lacking, there is no preview mode and explanations of statistical significance are not always consistent.

“Strong and user-friendly

Pros

UI is well designed and makes building complex experiments efficient.

Cons

I think they should have a mobile app to easily toggle experiments on and off.

“Perfect AB testing solution for newcomers

Pros

Its tech is solid with lots of features. Support is responsive and the thing I like the most about it is that it balances ease of use for marketers with enough technical depth for advanced developer setups.

Cons

The UI can seem complex to me because of so many features. So if you are a solo marketer without developer help, you will face roadblocks. You might need to pay more for extra features as your needs get more specific.

“Modern and dependable AB testing platform

Pros

Optimizely Web Experimentation gives us great flexibility and control making A/B and multivariate testing easy. We can constantly improve our site's performance and deliver tailored content that connects with our automotive customers.

Cons

It is a strong platform but can be complicated for teams without dedicated resources or experience. We rely on our agency for most experiment setups.

“Handles almost any experiment I throw at it

Pros

I've used Optimizely Web Experimentation for a couple of years. It can handle almost any experiment we throw at it, has strong reporting, frequently adds new features and performs well. The customer support has been very helpful whenever we needed it.

Cons

Well it is mostly easy to use but you do need basic CSS and DOM knowledge. Without that selecting the right elements to change or measure is frustrating.

“Incredible tool but on the expensive side

Pros

It has a great WYSIWYG editor and JS/CSS editor which makes edits flexible for both developers and non technical users. It can handle simple and complex tasks for us too.

Cons

Behavioral segmentation is limited unless we buy a higher tier plan.

“Solid A/B testing software

Pros

I love that it lets us track specific conversion types we define. The reporting clearly shows which variant wins and works well with minimal setup.

Cons

I found we needed more JavaScript development for multi-page tests and advanced changes. The tool prefers JS modifications over lots of HTML edits.

“Amazing product with responsive support when needed

Pros

This is a great A/B and personalization tool. It thoughtfully balances flexibility and customization with simplicity. When things get tricky or hard to find, their support is excellent and usually responds to us within a day or two.

Cons

We have had issues configuring SSO with our system which assumes email is the login ID. There is a workaround. Also there's one thing missing especially compared to a competitor is prioritizing multiple personalization activities on the same page.

“Optimizely makes experiments easy for all

Pros

Results and explanations for multivariate experiments help people across the business understand how variants perform without complicated stats.

Cons

One thing I have noticed is that some experiment metrics are technically hard to implement like offline conversions.

“It powers web experimentation

Pros

Optimizely Web Experimentation makes running web experiments easy. I'm impressed by how fast and simple it is to set up, deploy and manage tests even without deep technical knowledge. The ability to control experiment traffic percentages is one of the best features I have used. Being able to turn experiments on or off instantly has cut our mean time to resolve by at least 60%.

Cons

The initial learning curve was steep specially for new users without guidance. The documentation is detailed but does not speed things up for us. Recent UI changes made features harder to find and disrupted workflow, requiring extra clicks or searches.

“The ideal partner for fast experimentation

Pros

Planning, rolling out and tracking tests is pretty easy and much faster and cheaper than going through a dedicated dev team. The onboarding team was knowledgeable and flexible, I would say they are a great partner.

Cons

There is a bit of a learning curve but not too bad. Overall I would say it's worth the effort.

“Highly impressive features

Pros

The live editor lets you make custom changes on the fly. It's easy to use and unlike anything we have tried before. It puts control in the right hands and frees engineering from experimentation dependencies. Plus the edge capabilities are powerful for delivering optimized customer experiences.

Cons

We have noticed a little problem with testing, it would be awesome if our QA team could force themselves into any variation they want. Being able to pick and test whichever version they choose would make things way easier for them