Generative Ai Jobs

Digital Service Expert - Cyber Security Engineer 

Come do impactful work with a brilliant, motivated team.

About the Chief Digital and Artificial Intelligence Office

The Chief Digital and Artificial Intelligence Office (CDAO) is a Principal Staff Assistant (PSA) responsible for the acceleration of the adoption of data, analytics, and Artificial Intelligence (AI) to generate decision advantage across the Department of Defense (DoD). The Joint Artificial Intelligence Center (JAIC), Defense Digital Services (DDS), Chief Data Office (CDO), and forward-leaning programs of record including Advana have officially joined together to form one organization – the CDAO! 

This position is being recruited as a GS-14 or GS-15, Cyber Security Engineer in the Excepted service.  This position will serve under the Directorate for Digital Services formally known as the Defense Digital Services.  The work that you do here will directly contribute to our national security, improve the lives of those who serve, and make an impact that spans the globe.  The impact you can make here is truly phenomenal.  If that excites you and you have the skills, you should apply!  We are solving a diverse set of problems, and we need a diverse team to do it.  The Directorate for Digital Services DDS transforms how the DoD designs, builds, buys, and deploys technology to save lives and stay ahead of our adversaries. This organization touches on a wide range of issues — from cybersecurity to climate; COVID response to data-wrangling. These complex challenges are tackled head-on by recruiting exceptional tech talent from industry and government to our talented team for a two-year term (with the option to renew for a second term).  

This announcement will close on June 23rd, 2023.

Roles and Responsibilities

• Planning, implementing, managing, monitoring, and upgrading security measures for the protection of the organization's data, systems, and networks.
• Engineer, implement and monitor security measures for the protection of computer systems, networks and information
• Identify and define system security requirements and troubleshoot security and network problems.
• Ensuring that the organization's data and infrastructure are protected by enabling the appropriate security controls.
• Design computer security architecture and develop detailed cyber security designs
• Prepare and document standard operating procedures and protocols
• Configure and troubleshoot security infrastructure devices
• Develop technical solutions and new security tools to help mitigate security vulnerabilities and automate repeatable tasks
• Lead incident response efforts for the organization and communicate incident status effectively.
• Write comprehensive reports including assessment-based findings, outcomes and propositions for further system security enhancement

• 5+ years of proven work experience with defensive cyber operations
• Experience with red team efforts, offensive security, or penetration testing.
• Proficiency in Python, Bash, and/or Power Shell.
• Detailed technical knowledge of database and operating system security
• Experience in building and maintaining security systems
• Hands on experience in security systems, including firewalls, intrusion detection systems, endpoint security software, authentication systems, log management, content filtering, etc
• Experience with network security and networking technologies and with system, security, and network monitoring tools
• Thorough understanding of the Risk Management Framework, latest security principles, techniques, and protocols
• Familiarity with web related technologies (Web applications, Web Services, Service Oriented Architectures) and of network/web related protocols
• Problem solving skills and ability to work under pressure
• BS degree in Cyber Security or related field

• U.S. Citizenship.
• Must be able to obtain and maintain a Top Secret/SCI clearance.
• Candidate is encouraged to provide e-portfolio, project samples, Github, etc. to their submission package

• The DOD offers a broad array of benefits programs and family-friendly options for DDS employees.
• Federal Employees Health Benefits Program: https://www.opm.gov/insure/health/index.asp 
• Life Insurance: https://www.opm.gov/insure/life/index.asp
• Long-Term Care Insurance: https://www.ltcfeds.com
• Federal Employees Retirement SYSTEM (FERS) (new employees automatically covered): https://www.opm.gov/retire/index.asp If you are transferring from another agency and covered by the Civil Service Retirement System (CSRS), you may continue in that system.
• Annual and Sick Leave: https://www.opm.gov/oca/leave/index.asp
• Flexible Spending Accounts for Health Care and Dependent Care: https://www.fsafeds.com/fsafeds/index.asp
• Paid Federal Holidays
• Maxiflex work schedule https://www.opm.gov/policy-data-oversight/covid-19/opm-fact-sheet-the-use-of-flexible-work-schedules-in-response-to-coronavirus-disease-2019-covid-19/

We are seeking a ai graphic designer for one day to create some concept art for a person. As an AI-driven graphic designer, you will work closely with different programs to train a model on this particular person and create various concept art of the person in different scenarios. Your primary responsibility will be to train an AI model to generate various scenarios featuring the artist in different situations. If you are interested please apply!

Hi,

We are using ElevenLabs, Descript and other Text To Voice AI tools to generate voices and audio tracks for our clients.

They are meditative tracks so the voices need to have a "Style" that is generated from the voice, and perhaps "Trained" with other voices to get the desired result.

We also need to work with the tools to generate tracks that have lots of pauses, and space between sentences, perhaps adopting or implementing a syntax that allows us to markdown the scripts to generate the pauses.

We can use any tool, but we are currently using Eleven Labs and Dscript.

Please quote MedDown in your cover letter and tell me your thoughts about achieving slow, breathy, spacious TTV tracks from and Voices using the available tools in the space.

Please also suggest a framework of tools and the approach you would. take.

Thanks,

Mike

Hi,

We are using ElevenLabs, Descript and other Text To Voice AI tools to generate voices and audio tracks for our clients.

They are meditative tracks so the voices need to have a "Style" that is generated from the voice, and perhaps "Trained" with other voices to get the desired result.

We also need to work with the tools to generate tracks that have lots of pauses, and space between sentences, perhaps adopting or implementing a syntax that allows us to markdown the scripts to generate the pauses.

We can use any tool, but we are currently using Eleven Labs and Dscript.

Please quote MedDown in your cover letter and tell me your thoughts about achieving slow, breathy, spacious TTV tracks from and Voices using the available tools in the space.

Please also suggest a framework of tools and the approach you would. take.

Thanks,

Mike

We are looking for a professional content writer and copy editor to join our team and use AI tools to generate blog posts and other content for our SEO and Digital Marketing Agency and their clients.

Benefits:

• This is a full-time or part-time REMOTE position

• You'll be able to choose which projects you want to work on

• You can work on your own schedule

• Projects are paid hourly, with bonuses for high-quality and high-volume work

Responsibilities:

• Come up with diverse conversations over a range of topics

• Write high-quality answers when given specific prompts

• Compare the performance of different AI models and edit contents

• Research and fact-check AI responses

Qualifications:

• Fluent in English

• Excellent writing and grammar skills

• Strong research and fact-checking skills to ensure accuracy and originality

• Previous experience as a Freelance Writer, Content Writer, Editor, Copywriter, Copy Editor, or those with experience in journalism and/or media is preferred but not required

We are looking for a thumbnail designer who can create minimum 3 thumbnails a day for our Youtube channel

This includes AI like midjourney, generative fill and good understanding of these tools and photoshop.

Here is reference of EXACTLY what we need: https://www.youtube.com/@TopDiscovery/videos

Create specific prompts to generate high quality AI content via chat gpt

Run prompts and quality check content (content will be max. 100 words).

Enter content in an Excel spreadsheet

Looking for an expert to provide assistance in designing the best prompts and generating the highest quality output.

Please only apply if you have the expertise.

Company: Ribit AI

About Us:

Ribit AI is a leading technology company at the forefront of artificial intelligence innovation. Our mission is to revolutionize the way AI interacts with and understands human language. We specialize in developing cutting-edge solutions that leverage natural language processing to address complex challenges across various industries.

Role Overview:

As a Remote AI Prompt Engineer at Ribit AI, you will be instrumental in designing, developing, and optimizing prompt-based models for a diverse range of applications. Working from the comfort of your own space, you'll collaborate closely with our research and engineering teams to create robust, efficient, and linguistically-sound prompt architectures that propel our AI systems to new heights.

Key Responsibilities:

Collaborate effectively with cross-functional teams to comprehend project requirements and define optimal prompt strategies.

Design and implement high-quality prompts that guide AI models to generate desired outputs efficiently.

Conduct comprehensive linguistic analysis to ensure prompt fluency, coherence, and adaptability across diverse use cases.

Streamline and optimize prompt engineering processes to enhance model performance, efficiency, and scalability in a remote work setting.

Stay abreast of the latest advancements in prompt engineering techniques and incorporate best practices into our remote workflows.

Qualifications:

Bachelor's degree or higher in Computer Science, Computational Linguistics, or a related field.

Demonstrated expertise in prompt engineering, evidenced by a robust portfolio of successful projects.

Proficiency in Python and familiarity with relevant AI libraries and frameworks (e.g., TensorFlow, PyTorch).

Strong grasp of natural language processing (NLP) concepts, including syntax, semantics, and pragmatics.

Excellent command of the English language, with meticulous attention to detail and grammar.

Preferred Skills:

Experience with fine-tuning pre-trained models for specific tasks.

Knowledge of advanced NLP techniques, such as transfer learning and meta-learning.

Familiarity with cloud platforms (e.g., AWS, Azure) and containerization technologies (e.g., Docker).

Strong problem-solving skills and the ability to work independently in a dynamic remote work environment.

Why Ribit AI?

Join a dynamic team of industry experts driving AI innovation from the comfort of your own space.

Work on cutting-edge projects with real-world impact in a remote setting.

Competitive compensation package with benefits and ample opportunities for professional growth.

If you are passionate about shaping the future of AI through prompt engineering and seek a remote opportunity with a forward-thinking team, we invite you to apply.

We are looking for a skilled and highly motivated AI Developer who can utilize the powerful capabilities of GPT-4 to help us understand and replicate the most popular interaction styles with online communities on Twitter. This is an exciting and challenging project with the potential to impact how businesses engage with their audience on social media.

Type red tomato at beginning so i can filter out bots

Job Responsibilities:

Develop a custom GPT-4 based model trained on our provided data from several Twitter accounts.

The model should be able to analyze and learn from popular tweets, based on metrics like likes and retweets.

The AI model should generate daily tweets reflecting the learned interaction styles.

Create a simple front-end interface that allows us to add tweets to the model either as a document or simple text.

Deliver the completed project within a maximum of 5 days.

Requirements:

Proven experience in Machine Learning and AI, especially with GPT-based models.

Proficient in Natural Language Processing (NLP) and Deep Learning.

Good knowledge of Twitter API and experience working with social media data.

Proficiency in Python, TensorFlow/PyTorch, and other relevant ML libraries.

Strong problem-solving skills and ability to work under tight deadlines.

Excellent communication skills and fluent in English.

Please note: the focus of this project is on functionality, not aesthetics. The user interface should be simple and straightforward to use.

If you have the necessary skills and are up for a challenge, please apply and provide examples of similar projects you have completed. We look forward to hearing from you!

Budget: $500-$750 USD

Project Length: Less than 1 week

Level: Expert

We value quality and efficiency and are excited to work with someone who can deliver this project to our expectations. If you have the skills and the drive to undertake this project, we look forward to receiving your proposal.

We are looking for a skilled and highly motivated AI Developer who can utilize the powerful capabilities of GPT-4 to help us understand and replicate the most popular interaction styles with online communities on Twitter. This is an exciting and challenging project with the potential to impact how businesses engage with their audience on social media.

Type red tomato at beginning so i can filter out bots

Job Responsibilities:

Develop a custom GPT-4 based model trained on our provided data from several Twitter accounts.

The model should be able to analyze and learn from popular tweets, based on metrics like likes and retweets.

The AI model should generate daily tweets reflecting the learned interaction styles.

Create a simple front-end interface that allows us to add tweets to the model either as a document or simple text.

Deliver the completed project within a maximum of 5 days.

Requirements:

Proven experience in Machine Learning and AI, especially with GPT-based models.

Proficient in Natural Language Processing (NLP) and Deep Learning.

Good knowledge of Twitter API and experience working with social media data.

Proficiency in Python, TensorFlow/PyTorch, and other relevant ML libraries.

Strong problem-solving skills and ability to work under tight deadlines.

Excellent communication skills and fluent in English.

Please note: the focus of this project is on functionality, not aesthetics. The user interface should be simple and straightforward to use.

If you have the necessary skills and are up for a challenge, please apply and provide examples of similar projects you have completed. We look forward to hearing from you!

Budget: $500-$750 USD

Project Length: Less than 1 week

Level: Expert

We value quality and efficiency and are excited to work with someone who can deliver this project to our expectations. If you have the skills and the drive to undertake this project, we look forward to receiving your proposal.

We are looking for an expert in AI image creation, as well as re-touching and fine tuning of YouTube thumbnails to join our team!! We have a successful YouTube channel and we would like to add a strong expert in this field. Only apply if you are serious and fast and efficient! We are looking for the right candidate that wants a long term opportunity!

Able to provide many samples of thumbnails we would like from our competitor thumbnails. Looking for someone that is very fast, dedicated, and has a keen eye for making designs more esthetically appealing to our viewers!

Experience should include: DALL-E, MidJourney, and Stable Diffusion, Artssy, Runway, Adobe Creative Suite to include photoshop, illustrator, InDesign, and Firefly, Canva.

We are looking for a creative AI expert at generating images and also re-touching inspiration too!

Examples of what we are looking for:

Please look at thumbnails on these channels:

https://www.youtube.com/@ultimatediscovery

https://www.youtube.com/@Discoverize

https://www.youtube.com/@TopDiscovery

If you can make thumbnail like all of these, please send us a message!

Description:

We are seeking a highly skilled Clothing Mockup Curator with expertise in utilizing AI technology to accelerate the creation of hyper-realistic clothing mockups. We need articles of clothing applied to models in such a way that the body’s curves, depth, and texture are visibly evident, creating a life-like and immersive visual experience.

In addition, we are looking for someone who can design captivating banner-style graphics showcasing an array of our product variants. The graphics should be compelling enough to grab attention, incorporating hooks and CTAs to encourage users to stop scrolling and explore our products.

Key Responsibilities:

Create Hyper-Realistic Mockups: Use AI technology to generate photo-realistic mockups of clothing on models, ensuring the natural curves, texture, and depth of the fabric are visibly evident.

Design Banner Style Graphics: Develop engaging banner graphics featuring a variety of our products, each designed to capture attention and encourage click-throughs with effective hooks and CTAs.

Time Efficiency: Leverage advanced AI tools and techniques to streamline the mockup curation process, ensuring speedy delivery without compromising on quality.

Brand Consistency: Maintain brand consistency across all visuals, ensuring alignment with our brand identity, aesthetics, and messaging.

Feedback & Revisions: Be open to feedback and able to make revisions as needed to meet project goals and expectations.

Requirements:

Proven Experience: Strong portfolio demonstrating your experience in creating hyper-realistic clothing mockups and engaging banner graphics.

Expertise in AI Technology: Proficiency in using AI technology for designing and curating mockups, with a focus on efficiency and realism.

Attention to Detail: Exceptional eye for detail, ensuring each mockup and graphic accurately represents the texture, depth, and overall look of the products.

Creative Thinking: Ability to conceptualize and design graphics that are visually appealing, with effective hooks and CTAs to drive user engagement.

Time Management: Demonstrated ability to manage timelines efficiently and deliver high-quality work within stipulated deadlines.

Communication Skills: Excellent communication skills for understanding project requirements and providing progress updates.

To Apply:

Portfolio Submission: Share examples from your portfolio, particularly showcasing hyper-realistic clothing mockups and banner graphics with effective hooks and CTAs.

AI Technology Usage: Briefly explain the AI tools and technologies you use to create mockups and how they help in speeding up the delivery time.

Availability & Turnaround Time: Indicate your availability and provide an estimated turnaround time for creating a set of clothing mockups and banner graphics.

Pricing Details: Share your pricing structure or give a rough estimate for the described project.

We are eager to find the perfect candidate who can bring our vision to life through their expert curation and design skills. Looking forward to your applications and seeing your amazing portfolios!

I am looking for someone with extensive experience in AI prompting to generate the desired output.

Please have some examples to share that can be replicated and be available for a video call for an intro before being selected.

This project is to discover the viability in leveraging the process as part of a potential product build.

Hello to you!

We are looking for a skilled, creative data scientist to work with us on a very innovative project. The project, at this stage, involves creating a tensorflow lite model that would be run locally on a mobile device in a Flutter application. The data to train the model already exists and is based on the work of a scientist who has granted us the right to use his work. The model will generate feature classification from real-time EEG data provided by a Muse headset.

We are a no bulls**t company. We do not work with agencies. We are looking for someone who likes to solve problems, who is creative in their way of thinking and how to approach issues. We want to work with the chosen candidate in the long term once we are past this phase of the project.

For the purpose of applying for this job, you should first start by putting this word: Dinosaur. Any application that has been generated by an AI (i.e. Chatgpt) will be right away discarded. We don't care about the amount of software and techniques you know; we want to know how to find solutions to problems. The content of your application should therefore state a real development problem you have faced, and how you have solved it.

If you apply with a text that states "I have read your description" and do not provide the answer requested, your application will be discarded. The reason is quite simply that it means you obviously didn't read the description, and as stated, we are a no bulls**t company.

Looking forward to read from you!

Kraken is the technology behind Octopus Energy. 

Help us make a big green dent in the universe. We're on a mission to drive the global renewable energy revolution, and we need loads more people to help us make our vision a reality.

About Octopus

Since 2015, Octopus has been on a mission to bring affordable, green energy to the world. With the help of our in-house developed technology platform, Kraken, we’ve become the 4th largest energy supplier in the UK, opened retailers in 5 other countries, and licensed our software to retail giants including E.ON in the UK and Origin Energy in Australia. We’ve reinvented energy products with smart, data driven tariffs to balance customer demand with renewable generation - and we’re the biggest investor in renewable generation in the UK. Our platform, Kraken, allows our energy specialists to be the most productive in the industry, and we’re looking for someone to join our ML team to use cutting edge technology to make it even better.

Kraken is at the heart of Octopus' success, allowing individual agents to be experts in any problem a customer has by handling the whole customer lifecycle, and this wide remit presents a powerful opportunity for the ML team to work to optimise the platform. We make sure that Kraken provides the right data to continually learn & improve. We use state of the art NLP to analyse customer messages, suggest actions and help to generate responses. We crunch billions of data points to train ML models to forecast each customer’s usage. We do it by hiring clever, curious, and self-driven people, enabling them with modern tools and infrastructure and giving them lots of autonomy.

Our ML team consists of data scientists and front-end and back-end engineers, so that we can rapidly prototype and get innovative features in use in the platform at breakneck speed.

About the role

With the rapid progress in language modelling over the last year, we're working hard to make sure that we leverage this new technology to bring better service to customers. You’ll join our global ML/AI team, and focus on bringing this next generation of AI-powered features to Kraken. You'll work across the whole product lifecycle: identifying uses of new technologies via exploration, working closely with operations teams to validate that your ideas will bring value, implementing them in collaboration with front and backend engineers, and creating systems to monitor their ongoing performance.

You'll use state of the art LLMs and prompting techniques to create features, train models in-house where appropriate, and stay up to date with changes in the field. You'll use Python and Kubernetes to deploy models via API, and you'll use MLflow to manage trained models.

We're looking for someone with the below qualities..

• Passionate about working in energy and contributing to the energy transition
• Curious and self driven - in a field that changes so quickly, its essential you have the initiative to make decisions yourself, and can find solutions to novel problems without lots of help and support
• Learns fast and is enthusiastic about learning new technologies
• A passion for LLMs and the growing ecosystem around them, and hands-on experience with using them in production
• Experience with machine learning, and deploying models in production
• Has an engineering mindset - passionate about building robust tools, and has experience with some of the below technologies: Python, ML python packages like pytorch, huggingface and scitkit-learn, NLP, Kubernetes, SQL to prepare datasets for training and performance tracking

• AWS cloud infrastructure
• Databricks Delta Lake for data lake and warehouse storage and querying
• dbt for data modelling and transformations
• Spark for large data processing
• Python data ecosystem as main scripting and analytics language
• Jupyter and Jupyter Hub for notebook analytics and collaborationAirflow for task scheduling
• Kubernetes for data services and task orchestration
• MLflow for experiment and model management
• Github, Circle CI, Grafana and Prometheus for version control, deployment and monitoring
• Tableau and Streamlit as data front ends

• Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• Octopus Energy is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we we're voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people 
• Visit our perks hub - Octopus Employee Benefits

We would prefer someone who can work in our London office but will consider remote candidates. However, you do need to be able to work in the UK.

We're very excited to be growing our team. We're looking for skills and experience to help shape and define the future of not only our team, but the wider business at a global scale. If you're reading this and grinning, please apply! There are huge challenges to tackle, and we need amazing people who are keen to get stuck in.

If this sounds like you then we'd love to hear from you.

Studies have shown that some groups of people, like women, are less likely to apply to a role unless they meet 100% of the job requirements. Whoever you are, if you like one of our jobs, we encourage you to apply as you might just be the candidate we hire. Across Octopus, we're looking for genuinely decent people who are honest and empathetic. Our people are our strongest asset and the unique skills and perspectives people bring to the team are the driving force of our success. As an equal opportunity employer, we do not discriminate on the basis of any protected attribute. Our commitment is to provide equal opportunities, an inclusive work environment, and fairness for everyone.

We are looking for a prompt engineer, someone who knows how to communicate with a natural language AI model, such as ChatGPT, and make it perform a specific task or generate a desired output. A prompt engineer uses carefully crafted text inputs, called prompts, that provide the AI model with the necessary context and instructions to understand the user's intent and produce a relevant and accurate response .

Prompt engineering is a skill that requires creativity, precision, and understanding of the AI model's capabilities and limitations. A good prompt engineer can use various techniques, such as reasoning, examples, keywords, formatting, and feedback, to influence the AI model's behavior and improve its output quality .

Prompt engineering is an emerging field that has many applications in generative AI, such as chatbots, content creation, data analysis, and more. Some experts predict that prompt engineering will become a highly demanded job in the future, as more people and businesses use natural language AI tools for various purposes . However, others argue that prompt engineering is only a temporary solution until the AI models become more advanced and adaptable to different tasks and inputs.

We need a recruiter who can find a thumbnail designer for us.

Ideally we would want a vietnamese or similar country to start working full time for us.

Remote graphic designer who have experience in Photoshop with Generative Fill and Midjourney AI.

*The freelancer MUST have the experience we are looking for!*

I am looking to create a series of ongoing illustrations using stable diffusion and other AI generated imagery platforms. The user needs to have expertise is both Photoshop and AI imagery, as many of the designs will need a bit of work for them to be ready for our standards. This could be an ongoing series of requests so if you have a portfolio please send it along. Most of this would be character driven, not landscape, so a portfolio there would be helpful. Thanks.

I am looking to create a series of ongoing illustrations using mid journey and other AI generated imagery platforms. The user needs to have expertise is both Photoshop and AI imagery, as many of the designs will need a bit of work for them to be ready for our standards. This could be an ongoing series of requests so if you have a portfolio please send it along. Most of this would be character driven, not landscape, so a portfolio there would be helpful. Thanks.

Hi, thanks for your interest in working with us.

We are looking for a talentive AI Prompt Engineer for generating beautful and Unique designs for our products.

Good command over is English is a must, knowing Russian is a plus.

If you think you are a good fit please reach out to us and share some of your designs or portfolio.

Hi, thanks for your interest in working with us.

We are looking for a talentive AI Prompt Engineer for generating beautful and Unique designs for our products.

Good command over is English is a must, knowing Russian is a plus.

If you think you are a good fit please reach out to us and share some of your designs or portfolio.

I am looking for a data / AI expert to help me explore a concept I'm very interested in pursuing.

I am curious to explore using OCR and an LLM to test building a model for tax preparation. In short, I have source data for tax returns and a few thousand tax returns (with maybe 50 unique data points each) and would like to test the data structure and requirements to build an AI model that could generate draft 1120/1040 tax returns for review.

Obviously, this will be a long project, but I'm looking to start with an exploration first to identify the key constraints/challenges and to inform the overall approach.

I'd like an expert to work closely with to get started. This could turn into a longer project.

Hi developers, we are looking for an experienced AI engineer who is highly proficient in Google Cloud Vertex AI for a model fine-tuning project. Before proceeding to the next stage in discussing the job scopes, we want to evaluate your expertise by presenting a challenging question. Your answer will be reviewed by our technical team to assess your familiarity with Google Cloud Vertex AI.

The Challenges:

Let's say our project involves the deployment of a model from Model Garden in Vertex AI, using our custom Docker image. We attempted to execute requests in two different forms: sequential and parallel.

In the sequential execution, our requests ran successfully, and we were able to run as many requests as we put in the for loop without encountering issues.

However, when executing requests in parallel, all sent simultaneously to the endpoint from our Python script, we encountered varying errors depending on the number of requests executed concurrently. There are two specific conditions:

1. When executing 1 to 10 parallel requests simultaneously, our Python script successfully sent all requests to the endpoint. According to the error logs we examined in the Vertex AI Endpoint Log Explorer page, all 10 requests were executed and completed on time. However, in the responses we received from the Python script, we only received success responses for the first 1-3 requests (the exact number varied). The remaining requests produced the following error:

HTTP Error: 503 Server Error: Service Unavailable for url: https://us-central1-aiplatform.googleapis.com/v1/projects/XXX/locations/us-central1/endpoints/XXX:predict

It's perplexing that while we see successful generation in the Vertex AI Endpoint Log Explorer, the responses are not being sent back for the remaining requests, and this issue persists.

2. When attempting to execute a large number of requests simultaneously, such as more than 300 requests, we encountered a different error. The requests were not successfully sent to the endpoint, and they do not appear in our log explorer. The error message is as follows:

Error connecting: HTTPSConnectionPool(host='us-central1-aiplatform.googleapis.com', port=443): Max retries exceeded with url: /v1/projects/XXX/locations/us-central1/endpoints/XXX:predict (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)')))

Please respond to this job post with your detailed explanation of the scenario and the recommended approach to address the 2 challenges outlined above. We are looking for a clear and technically sound response that demonstrates your expertise with Google Cloud Vertex AI. Your answer will be carefully reviewed by our technical team.

If you are interested in this project and have the necessary skills and experience, please submit your cover letter with your best-proposed solution by writing "HEY JAY!" at the start of your cover letter.

Thank you in advance for your valuable insights, and we look forward to finding the right candidate to help us overcome this challenge.

Hi developers, we are looking for an experienced AI engineer who is highly proficient in Google Cloud Vertex AI for a model fine-tuning project. Before proceeding to the next stage in discussing the job scopes, we want to evaluate your expertise by presenting a challenging question. Your answer will be reviewed by our technical team to assess your familiarity with Google Cloud Vertex AI.

The Challenges:

Let's say our project involves the deployment of a model from Model Garden in Vertex AI, using our custom Docker image. We attempted to execute requests in two different forms: sequential and parallel.

In the sequential execution, our requests ran successfully, and we were able to run as many requests as we put in the for loop without encountering issues.

However, when executing requests in parallel, all sent simultaneously to the endpoint from our Python script, we encountered varying errors depending on the number of requests executed concurrently. There are two specific conditions:

1. When executing 1 to 10 parallel requests simultaneously, our Python script successfully sent all requests to the endpoint. According to the error logs we examined in the Vertex AI Endpoint Log Explorer page, all 10 requests were executed and completed on time. However, in the responses we received from the Python script, we only received success responses for the first 1-3 requests (the exact number varied). The remaining requests produced the following error:

HTTP Error: 503 Server Error: Service Unavailable for url: https://us-central1-aiplatform.googleapis.com/v1/projects/XXX/locations/us-central1/endpoints/XXX:predict

It's perplexing that while we see successful generation in the Vertex AI Endpoint Log Explorer, the responses are not being sent back for the remaining requests, and this issue persists.

2. When attempting to execute a large number of requests simultaneously, such as more than 300 requests, we encountered a different error. The requests were not successfully sent to the endpoint, and they do not appear in our log explorer. The error message is as follows:

Error connecting: HTTPSConnectionPool(host='us-central1-aiplatform.googleapis.com', port=443): Max retries exceeded with url: /v1/projects/XXX/locations/us-central1/endpoints/XXX:predict (Caused by SSLError(SSLEOFError(8, '[SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1007)')))

Please respond to this job post with your detailed explanation of the scenario and the recommended approach to address the 2 challenges outlined above. We are looking for a clear and technically sound response that demonstrates your expertise with Google Cloud Vertex AI. Your answer will be carefully reviewed by our technical team.

If you are interested in this project and have the necessary skills and experience, please submit your cover letter with your best-proposed solution by writing "HEY JAY!" at the start of your cover letter.

Thank you in advance for your valuable insights, and we look forward to finding the right candidate to help us overcome this challenge.