Skip to content

Commit 35416c7

Browse files
authored
test: point the live together_ai suites at a model together still serves (#37746)
Every live together_ai call in CI has answered 503 Service unavailable since 2026-08-20, across two runs 2.5 hours apart, while Together's status page reported no incident in either window. These are real calls, not replayed cassettes: the VCR layer runs filter_non_2xx_response, so a 503 is never written to a cassette and cannot be replayed back. Qwen/Qwen2.5-7B-Instruct-Turbo does not appear anywhere on Together's monitored component list, whose Qwen entries are all Qwen3.x, so a model-level outage there would never surface as an incident. The same 503 already forced test_basic_rerank_together_ai to be skipped on a different together_ai model, so per-model 503s are an established failure mode here rather than a platform outage. openai/gpt-oss-20b is the cheapest together_ai entry that carries real pricing and the capabilities these suites exercise, at $0.05/$0.20 per 1M tokens with function calling, response schema and tool choice. Together monitors it as a served component. The retired model also carries null pricing in the cost map, which is its own liability now that unpriced models are blocked. test_multiple_deployments.py keeps the old id: it is a router fallback list that is green today, and busting its cassette to prove a point would trade a passing test for a live call this change cannot vouch for.
1 parent 60225ab commit 35416c7

3 files changed

Lines changed: 5 additions & 5 deletions

File tree

tests/llm_translation/test_together_ai.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@
2020
class TestTogetherAI(BaseLLMChatTest):
2121
def get_base_completion_call_args(self) -> dict:
2222
litellm.set_verbose = True
23-
return {"model": "together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo"}
23+
return {"model": "together_ai/openai/gpt-oss-20b"}
2424

2525
def test_tool_call_no_arguments(self, tool_call_no_arguments):
2626
"""Test that tool calls with no arguments is translated correctly. Relevant issue: https://github.com/BerriAI/litellm/issues/6833"""

tests/local_testing/test_completion.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,7 @@ def test_completion_custom_provider_model_name():
6767
try:
6868
litellm.cache = None
6969
response = completion(
70-
model="together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo",
70+
model="together_ai/openai/gpt-oss-20b",
7171
messages=messages,
7272
logger_fn=logger_fn,
7373
)
@@ -2817,7 +2817,7 @@ def test_customprompt_together_ai():
28172817
print(litellm.success_callback)
28182818
print(litellm._async_success_callback)
28192819
response = completion(
2820-
model="together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo",
2820+
model="together_ai/openai/gpt-oss-20b",
28212821
messages=messages,
28222822
roles={
28232823
"system": {
@@ -3657,7 +3657,7 @@ def test_completion_together_ai_stream():
36573657
messages = [{"content": user_message, "role": "user"}]
36583658
try:
36593659
response = completion(
3660-
model="together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo",
3660+
model="together_ai/openai/gpt-oss-20b",
36613661
messages=messages,
36623662
stream=True,
36633663
max_tokens=5,

tests/local_testing/test_text_completion.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4036,7 +4036,7 @@ def test_async_text_completion_together_ai():
40364036
async def test_get_response():
40374037
try:
40384038
response = await litellm.atext_completion(
4039-
model="together_ai/Qwen/Qwen2.5-7B-Instruct-Turbo",
4039+
model="together_ai/openai/gpt-oss-20b",
40404040
prompt="good morning",
40414041
max_tokens=10,
40424042
)

0 commit comments

Comments
 (0)