Exclusive: NinjaTech launches autonomous AI agents powered by AWS chips — not GPUs

Published on:

NinjaTech AI, a Silicon Valley-based generative AI firm, has introduced the general public beta launch of its new AI agent service Ninja AI, an online software designed to behave as a researcher, software program engineer, scheduler/secretary, and extra. Customers can strive it out themselves now at myninja.ai.

The service operates a free tier and paid subscriptions. For paid customers, it offers entry (by way of the applying programming interfaces or APIs) to plenty of main generative AI fashions — together with OpenAI’s GPT-4o, Anthropic’s Claude 3, and Google Gemini.

Customers can choose between these AI fashions to energy plenty of underlying operations just by typing in pure language to Ninja AI, together with net search, a “deep search” carried out by a extra thorough AI agent powered by Llama 3.

- Advertisement -

It could actually evaluate outcomes from a number of AI fashions in realtime utilizing GPT-4 (summarizing the commonalities and flagging the variations), schedule calendar occasions on behalf of the human consumer and keep away from conflicts (doing so requires logging in with one’s Google account for Google Calendar, and an Apple iCal integration is on the roadmap for the close to future, as properly).

It could actually additional electronic mail invites to human recipients autonomously (this the agent can do by itself from its personal electronic mail tackle), converse to the consumer by way of completely different voices, even video chat to them with Unreal Engine-powered 3D characters.

And Ninja AI can do many of those duties concurrently and asynchronously, working within the background whereas the consumer does different duties with Ninja AI or elsewhere on their units.

The service will ping them when it completes an operation, and customers can test in on every workflow by clicking a sidebar. Additionally, in contrast to ChatGPT and different extra consumer-facing AI chabots, the consumer can kind a number of requests into Ninja AI without delay and it’ll attempt to do all of them within the order the consumer asks.

- Advertisement -
See also  LanceDB raises $11M to build an open-source multimodal AI database for app development

“Not every part is about query and reply,” mentioned Babak Pahlavan, founder and CEO of NinjaTech AI, in a video chat interview with VentureBeat. “Particularly in actual world, you want human assistants to take care of software program but additionally different people.”

The 5 key brokers provided by Ninja AI proper now embody:

  • Ninja Advisor
  • Ninja Coder
  • Fundamental Scheduler
  • Actual time Net Search
  • Restricted third-party LLM entry

Paid tiers supply extra duties

Ninja AI is designed to have a “beneficiant” free possibility within the phrases of Pahlavan, providing customers as much as 20 duties each day from the Advisor, Coder, Researcher, and third-party LLMs, in addition to 5 duties each day from the Scheduler agent

However customers prepared to pay $10, $20, or $30 month-to-month can get many extra duties each day and month-to-month because of this.

Pahlavan beforehand spent greater than a decade at Google, concluding his time there in 2022 as a Senior Director of Product Administration after overseeing varied enterprise software program verticals.

“My perception was we would have liked one thing that’s above and past query and answering techniques, regardless of how good they get,” Pahlavan informed VentureBeat. “And we nearly did it inside Google.”

After leaving the search large, he joined the nonprofit scientific analysis group SRI Worldwide as an entrepreneur-in-residence, which is the place the seeds of NinjaTech AI and Ninja AI had been planted.

- Advertisement -

Pahlavan’s co-founders embody Sam Naghshineh, previously an engineer of hyperscale techniques at Meta, who now serves as NinjaTech’s chief expertise officer (CTO) and Arash Sadrieh, an in depth pal of Pahlavan’s and former senior utilized scientist at Amazon Net Providers (AWS), who now serves as NinjaTech’s chief science officer.

See also  What is model quantization? Smaller, faster LLMs

“We’re principally are placing collectively every part we now have discovered from Google, AWS and Meta about tips on how to construct software program techniques at scale in a worldwide setting,” Pahlavan mentioned.

Picture of NinjaTech AI co-founders (L-R): Arash Sadrieh, Babak Pahlavan, Sam Naghshineh. Credit score: NinjaTech AI

Bold purpose of placing a number of AI fashions to work beneath one roof

The purpose is present a service for busy skilled shoppers (prosumers) to get essentially the most out of AI proper now, with out ready for some theoretical future breakthrough within the type of new fashions.

“The advisor agent has been educated on a number of thousand human, multi spherical conversations,” Pahlavan defined. “So it’s meant to be considerate, variety, clear, skilled, appropriate for work environments.”

Moreover: Ninja AI is designed to permit customers get the advantages of a number of AI fashions working collectively beneath one digital roof on their behalf — with out having to manually open completely different fashions and tab over.

“The core competency of the corporate is about brokers that may break down complicated duties, provide you with a plan dynamically, after which activate instruments which can be at our at its disposal with a view to execute these duties, both in actual time, asynchronously till the duty is finished, or till it will get blocked and it has a query for the consumer,” acknowledged Pahlavan.

Powered by AWS silicon

Apparently, NinjaTech AI eschews the main generative AI chips — graphics processing items (GPUs) from Nvidia — in favor of Amazon Net Providers (AWS) customized machine studying chips manufactured by accomplice Taiwanese Semiconductor Manufacturing Firm (TSMC).

NinjaTech used these chips, Trainium and Inferentia2, and Amazon’s cloud-based machine studying service, Amazon SageMaker, to construct, prepare, and scale its AI brokers and permit them to carry out a number of duties concurrently with out driving up prices for the younger startup.

See also  Sam Altman shares the next steps for AI at Microsoft Build

“We educated all of the fashions utilizing AWS Trainium through Sagemaker, after which every part can be being served utilizing Trainium and Inferentia,” mentioned Pahlavan.

Rahul Kulkarni, Director of Product Administration at AWS, commented on the collaboration’s advantages in a video name interview with VentureBeat, emphasizing that the customized silicon was supported and designed to work greatest with Amazon Sagemaker.

“It’s not simply delivering silicon, however it’s additionally delivering the precise framework within the software program capabilities to guarantee that it may be utilized by firms like NinjaTech,” Kulkarni famous.

However how less expensive are Inferentia2 chips than comparable Nvidia GPUs? AWS says clients can anticipate a 40% higher value per equal efficiency — up to some extent.

For tremendous demanding, computationally heavy operations, GPUs are nonetheless the way in which to go, and AWS affords them as properly by way of its elastic cloud (EC2) service.

“Our partnership with Nvidia continues to flourish and we are going to supply essentially the most up-to-date infrastructure at scale,” mentioned Kulkarni. “However equally necessary for us is our customized silicon initiative.”

With a workforce of consultants from Google, AWS, and Meta, NinjaTech AI goals to redefine productiveness by enabling customers to delegate time-consuming duties to their AI brokers, thereby specializing in extra strategic actions.

- Advertisment -

Related

- Advertisment -

Leave a Reply

Please enter your comment!
Please enter your name here