What causes "process_appid_not_exist, remove ip:%s" in XX-net/XX-Net?

Let the IP scanner rescan/replace IPs; ensure good_ip_list can refresh

process_appid_not_exist, remove ip:%s

Error message

process_appid_not_exist, remove ip:%s

What it means

While handling a 'appid not exist' report, the manager tried to verify by calling check_api(ip, 'xxnet-1') on the IP that reported it. The check failed (non-ok), so instead of disabling the appid it treats the IP as bad and force-removes it via ip_manager.report_connect_fail.

Source

Thrown at code/default/gae_proxy/local/appid_manager.py:86

        with self.lock:
            if appid not in self.out_of_quota_appids:
                self.out_of_quota_appids.append(appid)
            try:
                self.working_appid_list.remove(appid)
            except:
                pass

    def report_not_exist(self, appid, ip):
        self.logger.debug("report_not_exist:%s %s", appid, ip)
        th = threading.Thread(target=self.process_appid_not_exist, args=(appid, ip), name="process_appid_not_exist")
        th.start()

    def process_appid_not_exist(self, appid, ip):
        ret = self.check_api(ip, "xxnet-1")
        if ret and ret.ok:
            self.set_appid_not_exist(appid)
        else:
            self.logger.warn("process_appid_not_exist, remove ip:%s", ip)

            self.ip_manager.report_connect_fail(ip, force_remove=True)

    def set_appid_not_exist(self, appid):
        self.logger.warn("APPID_manager, set_appid_not_exist %s", appid)
        with self.lock:
            if appid not in self.not_exist_appids:
                self.not_exist_appids.append(appid)
            try:
                self.config.GAE_APPIDS.remove(appid)
            except:
                pass

            try:
                self.working_appid_list.remove(appid)
            except:
                pass

View on GitHub (pinned to cfa5bc17b6)

Solutions

Let the IP scanner rescan/replace IPs; ensure good_ip_list can refresh
Check network reachability to Google IPs
Re-verify the appid actually exists in your GCP console before assuming removal
Update XX-Net check logic if Google changed the check endpoint

Defensive patterns

Strategy: retry

Prevention

Maintain a healthy rotating IP pool so removed IPs are replaced
Verify appid existence in GCP console before relying on automated removal
Re-scan IPs after mass removal events

When it happens

Trigger: process_appid_not_exist called with an IP whose GAE endpoint no longer answers the check request (blocked, dead, or serving errors), making the verification request fail.

Common situations: GFE IP blocked by firewall, IP rotated out by Google, or local network interfering with the check request — commonly seen during IP blocking events.

Related errors

AI-assisted analysis of XX-net/XX-Net@cfa5bc17b6 (2026-08-27). Data as JSON: /api/errors/3194d50d224fc559. Report an issue: GitHub.