Blog Feed Post

Top 10 SaaS Data Access API Challenges in Data-Driven Marketing

Organizations and application developers rely on access to their data. Here are ten of the most common challenges they face—and how to solve them.

With the proliferation of data silos in SaaS CRM and Marketing applications, data-driven organizations and application developers are facing challenges in keeping up with the APIs specific to each system.  

SaaS applications have their own proprietary web service APIs across SOAP, REST, or both. While a developer or application may expect SQL support, in reality the implementations are SOQL, ROQL, and other variations on the standards.

Fragmentation across systems limits the data sources an application can support, and even leads to new projects like building a Marketing Data Lake

Businesses and developers expanding support to SaaS sources face these 10 major challenges.

  1. Some SaaS Sources do not have a query language

    For some SaaS vendors, it may not make sense to have a query language. In those cases, building standards based connectivity can be equally challenging since each object is exposed with a different API with each having unique rules for invoking, filtering, searching, etc.

  2. SaaS query languages have their own rules to access data

    Even if a source has a query language, each has its own rules for accessing data. For instance, one query language may be able to handle a particular query and whereas others cannot, which means connectivity or application code must handle it.

  3. SaaS sources do not necessarily support the entire SQL standard

    SaaS sources may have a query language that is a subset of SQL or "SQL like". For example, Salesforce Platform has SOQL while Oracle RightNow has ROQL. An application connecting to these sources must account for the unique variations.

  4. Multiple Data Formats to support - JSON, XML, CSV, etc.

    Each SaaS API format returns results in a different way (JSON, XML, CSV, etc.) making it hard to build a generic solution. Each API has different governors or limits for fetching, aggregating and sorting results. For example, some sources return a max of 10,000 results at a time, which the data access code has to manually page and reorder.

  5. CRUD operations for SaaS Applications are complex

    Updates, Deletes and Inserts with SaaS APIs are very different than relational databases. A SaaS API can require an ID to be fetched for each target object to be updated, which is inefficient for updating multiple objects that need to be chained to optimize network packets.

  6. No standard for exchanging dates

    All SaaS dates are exchanged in UTC, but not all clients expect dates in UTC. It’s up to the data access code to localize the date appropriately, and ensure the round trip is successful for writes.

  7. Different Security and Authentication Methods

    CRM and Marketing systems contain a company’s most valuable information—customer data. Each SaaS application has different challenges in authenticating users, and a security breach in support or implementation is simply not an option.

  8. Metadata can be Static or Dynamic

    SaaS applications support either static or dynamic object models. With dynamic object models, the schema needs to be discovered by the data access code. However, some applications do not detect changes to the schema.

  9. SaaS connectivity performance varies between different sources

    Even if you get the hang of building SaaS data connectivity, you will eventually run into sources that just won’t perform well under a certain workload. You will have to revisit all available APIs and architectures to fix this issue.

  10. SaaS APIs change rapidly

    Most importantly, SaaS APIs are always updating. While the updates appear seamless to end users, it is quite the opposite for data connectivity developers. For example, Salesforce.com changes their API once a quarter which means your code needs to be recompiled each time.

When confronting these challenges in supporting multiple CRM and Marketing SaaS systems, an application vendor or developer must determine the best solutions for their situation. Coding from the ground up for each data source may not be feasible, especially when time to market is an issue. 

Standards-based connectivity was created nearly 30 years ago to solve this exact dilemma. With a robust implementation, standardized connectors can provide access to many data sources with the consistency expected by application code.


DataDirect Hybrid Data Pipeline

Hybrid Data Pipeline is a powerful solution for the problem of multiple APIs for multiple data stores. Data Pipeline is a self-hosted hybrid connectivity service that you can run in the cloud or on-premises. Data Pipeline can give you access to data in the cloud or on-premises behind a firewall. Connect through a standard interface—SQL (ODBC, JDBC) or REST (OData)—to multiple data sources with just one code base. You don't have to learn every API—we do the work for you.

Download DataDirect Hybrid Data Pipeline and try your own Hybrid Connectivity service today!

Try Now!

Read the original blog entry...

More Stories By Progress Blog

Progress offers the leading platform for developing and deploying mission-critical, cognitive-first business applications powered by machine learning and predictive analytics.

Latest Stories
"ZeroStack is a startup in Silicon Valley. We're solving a very interesting problem around bringing public cloud convenience with private cloud control for enterprises and mid-size companies," explained Kamesh Pemmaraju, VP of Product Management at ZeroStack, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"Codigm is based on the cloud and we are here to explore marketing opportunities in America. Our mission is to make an ecosystem of the SW environment that anyone can understand, learn, teach, and develop the SW on the cloud," explained Sung Tae Ryu, CEO of Codigm, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, discussed how by using ne...
"CA has been doing a lot of things in the area of DevOps. Now we have a complete set of tool sets in order to enable customers to go all the way from planning to development to testing down to release into the operations," explained Aruna Ravichandran, Vice President of Global Marketing and Strategy at CA Technologies, in this SYS-CON.tv interview at DevOps Summit at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
Large industrial manufacturing organizations are adopting the agile principles of cloud software companies. The industrial manufacturing development process has not scaled over time. Now that design CAD teams are geographically distributed, centralizing their work is key. With large multi-gigabyte projects, outdated tools have stifled industrial team agility, time-to-market milestones, and impacted P&L stakeholders.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
Data scientists must access high-performance computing resources across a wide-area network. To achieve cloud-based HPC visualization, researchers must transfer datasets and visualization results efficiently. HPC clusters now compute GPU-accelerated visualization in the cloud cluster. To efficiently display results remotely, a high-performance, low-latency protocol transfers the display from the cluster to a remote desktop. Further, tools to easily mount remote datasets and efficiently transfer...
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventio...
"Akvelon is a software development company and we also provide consultancy services to folks who are looking to scale or accelerate their engineering roadmaps," explained Jeremiah Mothersell, Marketing Manager at Akvelon, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...