az vm image list can't find publisher

[SamaraSoucy-MSFT]

Describe the bug

Command Name
az vm image list

Errors:

Publisher: Symantec.test.ru4mp1.latest was not found.

To Reproduce:

Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

• Put any pre-requisite steps here...
• az vm image list --offer {} --all --location {} --output {} --debug
  (may only reproduce with the exact 'az vm image list --offer UbuntuServer --all --location eastus2' command

Expected Behavior

Environment Summary

Windows-10-10.0.18362-SP0
Python 3.6.6
Shell: powershell.exe

azure-cli 2.0.74

Extensions:
azure-devops 0.11.0
dev-spaces 1.0.3
webapp 0.2.19

Additional Context

Original customer thread MicrosoftDocs/azure-docs-cli#1732
I was able to reproduce it and I've sent an email with the debug log to the DL.

[bim-msft]

Feiyue Yu (@qwordy) Please take a look.

[qwordy]

I have reproduced the bug. Using '--debug', you can see this command can get lots of images, but in the end of the output, there is an error when retrieving image info from publisher Symantec.test.ru4mp1.latest. I think I may need to add some fault tolerance mechanism.

[farialima]

Having a similar issue :

bash-3.2$ az vm image list --offer Debian --all --location francecentral
Publisher: Microsoft.Azure.Extensions.Testb2e612e0-1c8c-40ed-93fe-a169ed7619cb-20190219154622 was not found.
bash-3.2$ 

This is problematic because it prevent discovering images. The only way to workaround it is to find (somehow) a publisher, and re-rerun with it, eg.

az vm image list --offer Debian --all --location francecentral --publisher credativ

Running with debug shows the following potential causes :

(...)
urllib3.connectionpool : https://management.azure.com:443 "GET /subscriptions/c0c11638-e31a-4ea3-815e-d33c8ef7e55b/providers/Microsoft.Compute/locations/francecentral/publishers/Microsoft.Az\
ure.Extensions.Testb2e612e0-1c8c-40ed-93fe-a169ed7619cb-20190219154622/artifacttypes/vmimage/offers?api-version=2019-07-01 HTTP/1.1" 404 175

(...)

msrest.http_logger :     'x-ms-request-id': '7401e2f6-5ab4-4aaf-8c81-41e86d9fb5da'

(...)

msrest.http_logger : Response content:
msrest.http_logger :     'x-ms-ratelimit-remaining-subscription-reads': '8268'
msrest.universal_http : Configuring request: timeout=100, verify=True, cert=None
msrest.http_logger :     'Transfer-Encoding': 'chunked'
msrest.http_logger : {                                                                                                                                                                         
  "error": {                                                                                                                                                                                   
    "code": "NotFound",                                                                                                                                                                        
    "message": "Publisher: Microsoft.Azure.Extensions.Testb2e612e0-1c8c-40ed-93fe-a169ed7619cb-20190219154622 was not found."                                                                  
  }                                                                                                                                                                                            
}

(...)

cli.azure.cli.core.util : Publisher: Microsoft.Azure.Extensions.Testb2e612e0-1c8c-40ed-93fe-a169ed7619cb-20190219154622 was not found.
Publisher: Microsoft.Azure.Extensions.Testb2e612e0-1c8c-40ed-93fe-a169ed7619cb-20190219154622 was not found.
az_command_data_logger : exit code: 1
telemetry.save : Save telemetry record of length 2553 in cache
telemetry.check : Returns Positive.
telemetry.main : Begin creating telemetry upload process.
telemetry.process : Creating upload process: "/usr/local/Cellar/azure-cli/2.0.79_2/libexec/bin/python /usr/local/Cellar/azure-cli/2.0.79_2/libexec/lib/python3.8/site-packages/azure/cli/telem\
etry/__init__.py /Users/francois/.azure"
telemetry.process : Return from creating process
telemetry.main : Finish creating telemetry upload process.
command ran in 343.665 seconds.
bash-3.2$ 

[BhargaviAnnadevara]

Similar issue reported here.

Running the command:
az vm image list -f "Windows-10" --all -otable

returns:
Publisher: Microsoft.Compute.TestSar was not found.

From what I see in the --debug logs, the location seems to be defaulting to northeurope when running from Azure Cloud Shell (vs probably a different location while running from a client).

I am consistently able to reproduce this error by passing northeurope as the --location (optional parameter) with the command regardless of where I run it from. I see that other locations like uksouth and centralindia work.

[MrBill2U]

While we wait for the code fix can someone please do a data fix to get rid of the reference to Symantec.test.ru4mp1.latest?

[qwordy]

Hi service team, could you help confirm and fix the data inconsistency problem?
In Azure CLI,
Step 1. use client.virtual_machine_images.list_publishers(location) to get publishers
Step 2. use client.virtual_machine_images.list_offers(location, publisher) to get offers
Step 3, 4, ...

Step 2 fails for some publishers retrieved from step 1